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works, not a text-heavy approach that puts you to sleep. 
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“Head First Python is a great introduction to not just the Python language, but Python as it’s used in the 
real world. The book goes beyond the syntax to teach you how to create applications for Android phones, 
Google’s App Engine, and more.” 

—— David Griffiths, author and Agile coach 

u Where other books start with theory and progress to examples, Head First Python right in with code 

and explains the theory as you read along. This is a much more effective learning environment, because 
it engages the reader to do from the very beginning. It was also just a joy to read. It was fun without 
being flippant and informative without being condescending. The breadth of examples and explanation 
covered the majority of what you’ll use in your job every day. I’ll recommend this book to anyone 
starting out on Python.” 

一 Jeremy Jones, coauthor of Python for Unix and Linux System Administration 

“Head First Python is a terrific book for getting a grounding in a language that is increasing in relevance 
day by day.” 
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experience.” 

—— Warren Keuffel, Software Development Magazine 
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—— Ward Cunningham，inventor of the Wiki and founder of the Hillside Group 


“Just the right tone for the geeked-out, casual-cool guru coder in all of us. The right reference for practi¬ 
cal development strategies — gets my brain going without having to slog through a bunch of tired, stale 
professor-speak.” 

—— Travis Kalanick, founder of Scour and Red Swoosh 
Member of the MIT TR100 
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mangled, and carried everywhere. Head First SQL is at the top of my stack. Heck, even the PDF I have 
for review is tattered and torn.” 

一 Bill Sawyer, ATG Curriculum Manager, Oracle 

“This book’s admirable clarity, humor and substantial doses of clever make it the sort of book that helps 
even non-programmers think well about problem-solving.” 

—— Cory Doctorow, co-editor of Boing Boing 
Author, Down and Out in the Magic Kingdom 
and Someone Comes to Town，Someone Leaves Town 
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“I received the book yesterday and started to read it.. .and I couldn’t stop. This is definitely tres ‘cool.’ It 
is fun, but they cover a lot of ground and they are right to the point. I’m really impressed.” 
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“One of the funniest and smartest books on software design I’ve ever read.” 

—— Aaron LaBerge, VP Technology, ESPN.com 


“What used to be a long trial and error learning process has now been reduced neatly into an engaging 
paperback.” 

—— Mike Davidson, CEO, Newsvine, Inc. 


“Elegant design is at the core of every chapter here, each concept conveyed with equal doses of 
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—— Ken Goldstein, Executive Vice President, Disney Online 

“I ▼ Head First HTML with CSS & XHTML — it teaches you everything you need to learn in a ‘fun-coated’ 
format.’’ 

—— Sally Applin, UI Designer and Artist 


“Usually when reading through a book or article on design patterns, I’d have to occasionally stick myself 
in the eye with something just to make sure I was paying attention. Not with this book. Odd as it may 
sound, this book makes learning about design patterns fun. 
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—— Eric Wuehler 
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meet pytfen 

Everyone loves lists 

You’re asking one question: “What makes Python different?” 

The short answer is: lots of things. The longer answers starts by stating that there’s 
lots that’s familiar, too. Python is a lot like any other general-purpose programming 
language, with statements, expressions, operators, functions, modules, methods, 
and classes. All the usual stuff, really. And then there’s the other stuff Python provides 
that makes the programmer’s life — your life — that little bit easier. You’ll start your tour 
of Python by learning about lists. But, before getting to that, there's another important 
question that needs answering... 


What’s to like about Python? 

Install Python 3 

Use IDLE to help learn Python 

Work effectively with IDLE 

Deal with complex data 

Create simple Python lists 

Lists are like arrays 

Add more data to your list 

Work with your list data 

For loops work with lists of any size 

Store lists within lists 

Check a list for a list 

Complex data is hard to process 

Handle many levels of nested lists 

Don’t repeat code; create a function 

Create a function in Python 

Recursion to the rescue! 
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sharing your coje 

Modules of functions 

Reusable code is great, but a shareable module is better. 

By sharing your code as a Python module, you open up your code to the entire Python 
community...and it’s always good to share, isn’t it? In this chapter, you’ll learn how to 
create, install, and distribute your own shareable modules. You’ll then load your module 
onto Python’s software sharing site on the Web, so that everyone can benefit from your 
work. Along the way, you’ll pick up a few new tricks relating to Python’s functions, too. 
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?!les and excepti9ns 

Dealing with errors 

It’s simply not enough to process your list data in your code. 

You need to be able to get your data into your programs with ease, too. It’s no surprise 
then that Python makes reading data from files easy. Which is great, until you 
consider what can go wrong when interacting with data external to your programs... 
and there are lots of things waiting to trip you up! When bad stuff happens, you need a 
strategy for getting out of trouble, and one such strategy is to deal with any exceptional 
situations using Python’s exception handling mechanism showcased in this chapter. 
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It’s all lines of text 75 
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Take a pass on the error 93 
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...Or add another level of exception handling 98 
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You’re done … except for one small thing 101 

Be specific with your exceptions 102 

Your Python Toolbox 103 
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persistence 

aving data to files 

is truly great to be able to process your file-based data. 

But what happens to your data when you’re done? Of course ， it’s best to save your 
data to a disk file, which allows you to use it again at some later date and time. Taking 
your memory-based data and storing it to disk is what persistence is all about. Python 


supports all the usual tools for writing to files and also provides some cool facilities for 
efficiently storing Python data. 
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Open your file in write mode 110 

Files are left open after an exception! 114 

Extend try with finally 115 
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Use with to work with files 120 

Default formats are unsuitable for files 124 
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Generic file I/O with pickle is the way to go! 137 
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cornptelienc[!ng data 

Work that data! 

Data comes in all shapes and sizes, formats and encodings. 

To work effectively with your data, you often have to manipulate and transform it into a 
common format to allow for efficient processing, sorting, and storage. In this chapter, 
you’ll explore Python goodies that help you work your data up into a sweat, allowing 
you to achieve data-munging greatness. 
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140 
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Bundling code with data 

It’s important to match your data structure choice to your data. 

And that choice can make a big difference to the complexity of your code. In Python, 
although really useful, lists and sets aren’t the only game in town. The Python dictionary 
lets you organize your data for speedy lookup by associating your data with names, not 
numbers. And when Python’s built-in data structures don’t quite cut it, the Python class 
statement lets you define your own. This chapter shows you how. 


Coach Kelly is back (with a new file format) 174 

Use a dictionary to associate data 178 
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Define a class 190 

Use class to define classes 191 

The importance of self 192 
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Web development 

Putting it all together 

Sooner or later, you’ll want to share your app with lots of people. 

You have many options for doing this. Pop your code on PyPI, send out lots of emails, put 
your code on a CD or USB, or simply install your app manually on the computers of those 
people who need it. Sounds like a lot of work...not to mention boring. Also, what happens 
when you produce the next best version of your code? What happens then? How do 
you manage the update? Let’s face it: it’s such a pain that you’ll think up really creative 
excuses not to. Luckily, you don’t have to do any of this: just create a webapp instead. And, 
as this chapter demonstrates, using Python for web development is a breeze. 
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mobile app development 

Small devices 

Putting your data on the Web opens up all types of possibilities. 

Not only can anyone from anywhere interact with your webapp, but they are increasingly 
doing so from a collection of diverse computing devices: PCs, laptops, tablets, palmtops, 
and even mobile phones. And it’s not just humans interacting with your webapp that 
you have to support and worry about: bots are small programs that can automate web 
interactions and typically want your data, not your human-friendly HTML. In this chapter, 
you exploit Python on Coach Kelly’s mobile phone to write an app that interacts with your 
webapp’s data. 
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Don’t worry about Python 2 259 
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manage your data 

Handling input 

The Web and your phone are not just great ways to display data. 

They are also great tools to for accepting input from your users. Of course, once your 
webapp accepts data, it needs to put it somewhere, and the choices you make when 
deciding what and where this “somewhere” is are often the difference between a webapp 
that’s easy to grow and extend and one that isn’t. In this chapter, you’ll extend your 
webapp to accept data from the Web (via a browser or from an Android phone), as well 
as look at and enhance your back-end data-management services. 


Your athlete times app has gone national 294 

Use a form or dialog to accept input 295 
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scaling your Webapp 

Getting real 

The Web is a great place to host your app...until things get real. 

Sooner or later, you’ll hit the jackpot and your webapp will be wildly successful. When 
that happens, your webapp goes from a handful of hits a day to thousands, possibly ten 
of thousands, or even more. Will you be ready? Will your web server handle the load? 
How will you know? What will it cost? Who will pay? Can your data model scale to 
millions upon millions of data items without slowing to a crawl? Getting a webapp up and 
running is easy with Python and now, thanks to Google App Engine, scaling a Python 
webapp is achievable, too. 



There are whale sightings everywhere 352 

The HFWWG needs to automate 353 
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deeding With complex^ 

Data wrangling 

It’s great when you can apply Python to a specific domain area. 

Whether it’s web development, database management, or mobile apps, Python helps 
you get the job done by not getting in the way of you coding your solution. And then 
there’s the other types of problems: the ones you can’t categorize or attach to a domain. 
Problems that are in themselves so unique you have to look at them in a different, highly 
specific way. Creating bespoke software solutions to these type of problems is an area 
where Python excels. In this, your final chapter, you’ll stretch your Python skills to the 
limit and solve problems along the way. 
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So...what’s the problem? 400 

Start with the data 401 

Store each time as a dictionary 407 

Dissect the prediction code 409 

Get input from your user 413 

Getting input raises an issue... 414 

Search for the closest match 416 

The trouble is with time 418 

The time-to-seconds-to-time module 419 

The trouble is still with time … 422 

Port to Android 424 

Your Android app is a bunch of dialogs 425 

Put your app together... 429 

Your app’s a wrap! 431 

Your Python Toolbox 432 



XX 
































table of contents 


leftovers 



The Top Ten Things (we didn’t cover) 

You’ve come a long way. 

But learning about Python is an activity that never stops. The more Python you code, 
the more you’ll need to learn new ways to do certain things. You’ll need to master new 
tools and new techniques, too. There’s just not enough room in this book to show you 
everything you might possibly need to know about Python. So, here’s our list of the top 
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how to use this book 


Who is this book for? 


If you can answer “yes” to all of these: 

Do you already know how to program in another 
programming language? 

Do you wish you had the know-how to program Python, 
add it to your list of tools, and make it do new things? 

Do you prefer actually doing things and applying the stuff 
you learn over listening to someone in a lecture rattle on 
for hours on end? 


this book is for you. 


Who should probably back away from this book? 

If you can answer “yes” to any of these: 


o 

O 

o 


Do you already know most of what you need to know to 
program with Python? 

Are you looking for a reference book to Python, one that 
covers all the details in excruciating detail? 

Would you rather have your toenails pulled out by 15 
screaming monkeys than learn something new? Do you 
believe a Python book should cover everything and if it 
bores the reader to tears in the process then so much the 
better? 


this book is not for you. 
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Wc know what youVc thinking 


cc 


cc 


How can this be a serious Python book? 
What’s with all the graphics?” 

Can I actually learn it this way?” 


55 


Wc know what your brain is thinking 

Your brain craves novelty. It’s always searching, scanning, waiting for something 
unusual. It was built that way, and it helps you stay alive. 

So what does your brain do with all the routine, ordinary, normal things 
you encounter? Everything it can to stop them from interfering with the 
brain’s real]oh 一 recording things that matter. It doesn’t bother saving the 
boring things; they never make it past the “this is obviously not important’ 
filter. 




How does your brain know what’s important? Suppose you’re out for a day 
hike and a tiger jumps in front of you, what happens inside your head and 
body? 

Neurons fire. Emotions crank up. Chemicals surge. 

And that’s how your brain knows... 

This must be important! Don’t forget it! 

But imagine you’re at home, or in a library. It’s a safe, warm, tiger-free zone. \J 0 \^c 
You’re studying. Getting ready for an exam. Or trying to learn some tough 十 \\\ 孓 、 s 
technical topic your boss thinks will take a week, ten days at the most. sd、—. 

Just one problem. Your brain’s trying to do you a big favor. It’s trying to 
make sure that this obviously non-important content doesn’t clutter up scarce 
resources. Resources that are better spent storing the really big things. 

Like tigers. Like the danger of fire. Like how you should never have 
posted those “party” photos on your Facebook page. And there’s no 
simple way to tell your brain, “Hey brain, thank you very much, but 
no matter how dull this book is, and how little I’m registering on the 
emotional Richter scale right now, I really do want you to keep this 
stuff around.” 
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Metacognition: thinking about thinking 

If you really want to learn, and you want to learn more quickly and more 
deeply, pay attention to how you pay attention. Think about how you think. 
Learn how you learn. 

Most of us did not take courses on metacognition or learning theory when we 
were growing up. We were expected to learn, but rarely taught to learn. 


I wonder how 
I can trick my brain 
into remembering 
this stuff... 



The trick is to get your brain to see the new material you’re learning as 
Really Important. Crucial to your well-being. As important as a tiger. 
Otherwise, you’re in for a constant battle, with your brain doing its best to 
keep the new content from sticking. 


But we assume that if you’re holding this book, you really want to learn how 
to design user-friendly websites. And you probably don’t want to spend a lot 
of time. If you want to use what you read in this book, you need to remember 
what you read. And for that, you’ve got to understand it. To get the most from 
this book, or any book or learning experience, take responsibility for your brain. 
Your brain on this content. 


So just how DO you get your brain to treat 
programming like it was a hungry tiger? 


There’s the slow, tedious way, or the faster, more effective way. The 
slow way is about sheer repetition. You obviously know that you are able to learn 
and remember even the dullest of topics if you keep pounding the same thing into your 
brain. With enough repetition, your brain says, “This doesn’t feel important to him, but he 


keeps looking at the same thing over and over and over, so I suppose it must be.” 


The faster way is to do anything that increases brain activity, especially different 
types of brain activity. The things on the previous page are a big part of the solution, 
and they’re all things that have been proven to help your brain work in your favor. For 
example, studies show that putting words within the pictures they describe (as opposed to 
somewhere else in the page, like a caption or in the body text) causes your brain to try to 
makes sense of how the words and picture relate, and this causes more neurons to fire. 
More neurons firing = more chances for your brain to get that this is something worth 
paying attention to, and possibly recording. 


A conversational style helps because people tend to pay more attention when they 
perceive that they’re in a conversation, since they’re expected to follow along and hold up 
their end. The amazing thing is, your brain doesn’t necessarily care that the “conversation” 
is between you and a book! On the other hand, if the writing style is formal and dry, your 
brain perceives it the same way you experience being lectured to while sitting in a roomful 
of passive attendees. No need to stay awake. 


But pictures and conversational style are just the beginning... 
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Here's what WE did: 

We used pictures, because your brain is tuned for visuals, not text. As far as your brain’s 
concerned, a picture really is worth a thousand words. And when text and pictures work 
together, we embedded the text in the pictures because your brain works more effectively 
when the text is within the thing the text refers to, as opposed to in a caption or buried in the 
text somewhere. 

We used redundancy : saying the same thing in different ways and with different media types, 
and multiple senses, to increase the chance that the content gets coded into more than one area 
of your brain. 

We used concepts and pictures in unexpected ways because your brain is tuned for novelty, 
and we used pictures and ideas with at least some emotional content, because your brain 
is tuned to pay attention to the biochemistry of emotions. That which causes you to feel 
something is more likely to be remembered, even if that feeling is nothing more than a little 

humor, surprise, or interest. 

We used a personalized, conversational style, because your brain is tuned to pay more 
attention when it believes you’re in a conversation than if it thinks you’re passively listening 
to a presentation. Your brain does this even when you’re reading. 


We included more than 80 activities^ because your brain is tuned to learn and remember 
more when you do things than when you read about things. And we made the exercises 
challenging-yet-do-able, because that’s what most people prefer. 

We used multiple learning styles, because jo?/ might prefer step-by-step procedures, while 
someone else wants to understand the big picture first, and someone else just wants to see 
an example. But regardless of your own learning preference, everyone benefits from seeing the 
same content represented in multiple ways. 

We include content for both sides of your brain, because the more of your brain you 
engage, the more likely you are to learn and remember, and the longer you can stay focused. 
Since working one side of the brain often means giving the other side a chance to rest, you 
can be more productive at learning for a longer period of time. 

And we included stories and exercises that present more than one point of viezv } 
because your brain is tuned to learn more deeply when it’s forced to make evaluations and 
judgments. 

We included challenges, with exercises, and by asking questions that don’t always have 
a straight answer, because your brain is tuned to learn and remember when it has to work at 
something. Think about it ― you can’t get your body in shape just by watching people at the 
gym. But we did our best to make sure that when you’re working hard, it’s on the right things. 
Thdityou } re not spending one extra dendrite processing a hard-to-understand example, 
or parsing difficult, jargon-laden, or overly terse text. 

We people. In stories, examples, pictures, etc., because, well, because a person. 
And your brain pays more attention to people than it does to things. 
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Here's what YOU caw do to bend 
your brain iwto submission 

So, we did our part. The rest is up to you. These tips are a 
starting point; listen to your brain and figure out what works 
for you and what doesn’t. Try new things. 

Cut -this out «>hd sti 乙 k 


o Slow down. The more you understand, the 
less you have to memorize. 

Don’t just read. Stop and think. When the book asks 
you a question, don’t just skip to the answer. Imagine 
that someone really is asking the question. The 
more deeply you force your brain to think, the better 
chance you have of learning and remembering. 

Do the exercises. Write your own notes. 

We put them in, but if we did them for you, that 
would be like having someone else do your workouts 
for you. And don’t just look at the exercises. Use a 
pencil. There’s plenty of evidence that physical 
activity while learning can increase the learning. 

❺ Read the “There are No Dumb Questions ■” 

That means all of them. They’re not optional 
sidebars, they ’re part of the core content! 

Don’t skip them. 


o Drink water. Lots of it. 

Your brain works best in a nice bath of fluid. 
Dehydration (which can happen before you ever 
feel thirsty) decreases cognitive function. 

o Listen to your brain. 

Pay attention to whether your brain is getting 
overloaded. If you find yourself starting to skim 
the surface or forget what you just read, it’s time 
for a break. Once you go past a certain point, you 
won’t learn faster by trying to shove more in, and 
you might even hurt the process. 

o Feel something. 

Your brain needs to know that this matters. Get 
involved with the stories. Make up your own 
captions for the photos. Groaning over a bad joke 
is still better than feeling nothing at all. 


Make this the last thing you read before bed. 
Or at least the last challenging thing. 


Part of the learning (especially the transfer to 
long-term memory) happens after yow put the book 
down. Your brain needs time on its own, to do more 
processing. If you put in something new during that 
processing time, some of what you just learned will 
be lost. 


(D Talk about it. Out loud. 

Speaking activates a different part of the brain. If 
you’re trying to understand something, or increase 
your chance of remembering it later, say it out loud. 
Better still, try to explain it out loud to someone else. 
You’ll learn more quickly, and you might uncover 
ideas you hadn’t known were there when you were 
reading about it. 


Write a lot of code! 

There’s only one way to learn to program: writing 
a lot of code. And that’s what you’re going to 
do throughout this book. Coding is a skill, and the 
only way to get good at it is to practice. We’re going 
to give you a lot of practice: every chapter has 
exercises that pose a problem for you to solve. Don’t 
just skip over them —— a lot of the learning happens 
when you solve the exercises. We included a solution 
to each exercise —— don’t be afraid to peek at the 
solution if you get stuck! (It’s easy to get snagged 
on something small.) But try to solve the problem 
before you look at the solution. And definitely get it 
working before you move on to the next part of the 
book. 


you are here ► 


XXIX 








how to use this book 


Read Me 

This is a learning experience, not a reference book. We deliberately stripped out everything 
that might get in the way of learning whatever it is we’re working on at that point in the 
book. And the first time through, you need to begin at the beginning, because the book 
makes assumptions about what you’ve already seen and learned. 


This book is designed to get you up to speed with Python as 
quickly as possible. 

As you need to know stuff, we teach it. So you won’t find long lists of technical material, no 
tables of Python’s operators, not its operator precedence rules. We don’t cover everything, 
but we’ve worked really hard to cover the essential material as well as we can, so that you 
can get Python into your brain quickly and have it stay there. The only assumption we make 
is that you already know how to program in some other programming language. 

This book targets Python 3 

We use Release 3 of the Python programming language in this book, and we cover how to 
get and install Python 3 in the first chapter. That said, we don’t completely ignore Release 
2, as you’ll discover in Chapters 8 through 11. But trust us, by then you’ll be so happy using 
Python, you won’t notice that the technologies you’re programming are running Python 2. 

We put Python to work for you right away. 

We get you doing useful stuff in Chapter 1 and build from there. There’s no hanging 
around, because we want you to be productive with Python right away. 


The activities are NOT optional. 

The exercises and activities are not add-ons; they’re part of the core content of the book. 
Some of them are to help with memory, some are for understanding, and some will help 
you apply what you’ve learned. Don } t skip the exercises. 

The redundancy is intentional and important. 

One distinct difference in a Head First book is that we want you to really get it. And we 
want you to finish the book remembering what you’ve learned. Most reference books don’t 
have retention and recall as a goal, but this book is about learning, so you’ll see some of the 
same concepts come up more than once. 
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The examples are as lean as possible. 


Our readers tell us that it’s frustrating to wade through 200 lines of an example looking 
for the two lines they need to understand. Most examples in this book are shown within 
the smallest possible context, so that the part you’re trying to learn is clear and simple. 
Don’t expect all of the examples to be robust, or even complete —— they are written 
specifically for learning, and aren’t always fully functional. 

We’ve placed a lot of the code examples on the Web so you can copy and paste them as 
needed. You’ll find them at two locations: 

http:/ / www. headfirstlabs. com/books/hfpython/ 
http://python, itcarlozv.ie 

The Brain Power exercises don’t have answers. 

For some of them, there is no right answer, and for others, part of the learning 
experience of the Brain Power activities is for you to decide if and when your answers 
are right. In some of the Brain Power exercises, you will find hints to point you in the 
right direction. 
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Phil Hartley has a degree in Computer Science 
from Edinburgh, Scotland. Having spent more than 
30 years in the IT industry with specific expertise in 
OOP, he is now teaching full time at the University 
of Advancing Technology in Tempe, AZ. In his spare 
time, Phil is a raving NFL fanatic 

Jeremy Jones is coauthor of Python for Unix and 
Linux System Administration. He has been actively using 
Python since 2001. He has been a developer, system 
administrator, quality assurance engineer, and tech 
support analyst. They all have their rewards and 
challenges, but his most challenging and rewarding job 
has been husband and father. 


xxxii intro 



















the intro 


Acknowledgments 


My editor: 

Brian Sawyer was Head First Python’s editor. When not editing 



books, Brian likes to run marathons in his spare time. This turns out 
to be the perfect training for working on another book with me (our 
second together). O’Reilly and Head First are lucky to have someone 
of Brian’s caliber working to make this and other books the best they 
can be. 


The O’Reilly team: 

Karen Shaner provided administrative support and very capably coordinated the techical review process, responding 
quickly to my many queries and requests for help. There’s also the back-room gang to thank —— the O’Reilly Production 
Team — who guided this book through its final stages and turned my InDesign files into the beautiful thing you’re 
holding in your hands right now (or maybe you’re on an iPad, Android tablet, or reading on your PC —— that’s cool, too). 

And thanks to the other Head First authors who, via Twitter, offered cheers, suggestions, and encouragement 
throughout the entire writing process. You might not think 140 characters make a big difference, but they really do. 

I am also grateful to Bert Bates who, together with Kathy Sierra, created this series of books with their wonderful 
Head First Java. At the start of this book, Bert took the time to set the tone with a marathon 90-minute phone call, 
which stretched my thinking on what I wanted to do to the limit and pushed me to write a better book. Now, some nine 
months after the phone call, I’m pretty sure I’ve recovered from the mind-bending Bert put me through. 

Friends and colleagues: 

My thanks again to Nigel Whyte, Head of Department, Computing and Networking at The Institute of Technology, 
Carlow, for supporting my involvement in yet another book (especially so soon after the last one). 

My students (those enrolled on 3rd Year Games Development and 4th Year Software Engineering) have been exposed 
to this material in various forms over the last 18 months. Their positive reaction to Python and the approach I take with 
my classes helped inform the structure and eventual content of this book. (And yes, folks, some of this is on your final). 



My family, Deirdre, Joseph, Aaron, and Aideen had to, once more, bear the grunts and groans, huffs and puffs, 
and more than a few roars on more than one occasion (although, to be honest, not as often they did with Head First 
Programming). After the last book, I promised I wouldn’t start another one “for a while.” It turned out “a while” was no 
more than a few weeks, and I’ll be forever grateful that they didn’t gang up and throw me out of the house for breaking 
my promise. Without their support, and especially the ongoing love and support of my wife, Deirdre, this book would 
not have seen the light of day. 

The zvithout-zvhom list: 

My technical review team did an excellent job of keeping me straight and making sure what I covered was spot on. 
They confirmed when my material was working, challenged me when it wasn’t and not only pointed out when stuff 
was wrong, but provided suggestions on how to fix it. This is especially true of David Griffiths, my co-conspirator on 
Head First Programming, whose technical review comments went above and beyond the call of duty. David’s name might 
not be on the cover of this book, but a lot of his ideas and suggestions grace its pages, and I was thrilled and will forever 
remain grateful that he approached his role as tech reviewer on Head First Python with such gusto. 


you are here ► xxxm 










safari books online 


Safari® Pooks Online 
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1 meet python 




^ Everyone loves lists ♦ 



You’re asking one question: “What makes Python different?” 

The short answer is: lots of things. The longer answers starts by stating that there’s lots 
that’s familiar, too. Python is a lot like any other general-purpose programming language, 
with statements, expressions, operators, functions, modules, methods, and classes. 
All the usual stuff, really. And then there’s the other stuff Python provides that makes 
the programmer’s life — your life — that little bit easier. You’ll start your tour of Python by 
learning about lists. But, before getting to that, there’s another important question that 
needs answering... 


this is a new chapter 






python greatness 


Whaf s to like about Pythow? 

Lots. Rather than tell you, this book’s goal is to show you the greatness that is 
Python. 




Yeah... I need something that I can deploy 
on PCs, Macs, handhelds, phones,the Web, 
on big servers and small clients...and it has 
to let me build GUIs quickly and painlessly... 
OK, yes, yeah, Tm listening... What?!? 
Youre kidding! Python can do all that? 



Before diving head first into Python, let’s get a bit of housekeeping out of 
the way. 

To work with and execute the Python code in this book, you need a copy of 
the Python 3 interpreter on your computer. Like a lot of things to do with 
Python, it’s not difficult to install the interpreter. Assuming, of course, it’s not 
already there … 
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Install Pythow 3 


Before you write and run Python code, you need to make sure the Python 
interpreter is on your computer. In this book, you’ll start out with Release 3 of 
Python, the very latest (and best) version of the language. 

A release of Python might already be on your computer. Mac OS X comes 
with Python 2 preinstalled, as do most versions of Linux (which can also ship 
with Release 3). Windows, in contrast, doesn’t include any release of Python. 
Let’s check your computer for Python 3. Open up a command-line prompt 
and, if you are using Mac OS X or Linux, type: 


python3 







On Windows, use this command: 


c:\Python31\python.exe 











If Python 3 is missing from 
your computer, download 
a copy for your favorite OS 
from the zvzvzv.python. org 
website. 
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$ python3 -V 
Python 3.1.2 
$ 

$ python3 

Python 3.1.2 (r312:79360M, Mar 24 2010, 01:33:18) 

[GCC 4.0.1 (Apple Inc. build 5493)] on darwin 

Type "help", "copyright ", "credits" or "license" for more info 

»> 

»> quit () 


When you install Python 3, you also get IDLE, Python’s simple — yet 
surprisingly useful — integrated development environment. IDLE includes a 
color syntax-highlighting editor, a debugger, the Python Shell, and a complete 
copy of Python 3’s online documentation set. 


Let’s take a quick look at IDLE. 
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idle hands 


Use IPLE to help learn Pythow 


IDLE lets you write code in its full-featured code editor as well as experiment 
with code at the Python Shell. You’ll use the code editor later in this book 
but, when learning Python, IDLE’s shell really rocks, because it lets you try 
out new Python code as you go. 


When you first start IDLE, you are presented with the “triple chevron” 
prompt (»>) at which you enter code. The shell takes your code statement 
and immediately executes it for you, displaying any results produced on screen. 

IDLE knows all about Python syntax and offers “completion hints” that pop 
up when you use a built-in function like print () . Python programmers 
generally refer to built-in functions as BIFs. The print () BIF displays 
messages to standard output (usually the screen). 
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Python Shell 
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Python 3.1.2 (r312i79360M f Mar 24 2010 f 01:33:IB 
[GCC 4.0.1 (Apple Inc. build 5493)] on darwin 

Type "copyright M , "credits " or 11 license) ) " for more y^nformation 
>» 

»> print ( "You can experiment with code within^SlE 1 s shell. Cool 
You can experiment with code within IDLE f sCool, eh? 

»> if 43 > 42i 

print (" Don，t panic 1 11 ) 


Don f t panic! 
>» I 


eh? 1 " ) 


Ln: 12 


Col: 4 
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IDLE uses colored syntax to highlight your code. By default, built-in 
functions are purple, strings are green, and language keywords (like if) are 
orange. Any results produced are in blue. If you hate these color choices, 
don’t worry; you can easily change them by adjusting IDLE’s preferences. 

IDLE also knows all about Python’s indentation syntax, which requires code 
blocks be indented. When you start with Python, this can be hard to get 
used to, but IDLE keeps you straight by automatically indenting as needed. 


IDLE knows 

Pytlion’s syntax 
and kelps you 
conform to 
tke Pytkon 
indentation rules. 
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Work effectively with 1PLE 


IDLE has lots of features, but you need to know about only 
a few of them to get going. 

TAP completion 

Start to type in some code, and then press the TAB key. 
IDLE will offer suggestions to help you complete your 
statement. 
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: h code within IDLE ' s shell. Cool, eh? 

Cyanic 1") 

▲ 

▼ 


jLn: 12 Col: 6 

A 


Recall code statements 

Press Alt-P to recall the previous code statement entered into 
IDLE or press Alt-N to move to the next code statement 
(assuming there is one). Both key combinations can be used 
to cycle rapidly through all of the code you’ve entered into 
IDLE, re-executing any code statements as needed. 




Alt-P for P 


Alt-N lor Next \ 


unless youVc 0Y\ J 
a Mac., m 
tase vt 、 C*W - P 
av\A CW-K* 


Edit recalled code 

Once you recall your code statement, you can edit it and 
move around the statement using the arrow keys. It’s 
possible to edit any statement that you’ve previously 
entered, even code statements that span multiple lines. 

Adjust IPLE's preferences 

IDLE’s preferences dialog lets you adjust its default T>we3k |pLt 

behavior to your tastes. There are four tabs of settings to ^ youv V\cav-*t s ， 

tweak. You can control font and tab behavior, the colors 

used to syntax highlight, the behavior of certain key- 

combinations, and IDLE’s start-up settings. So, if shocking 

pink strings is really your thing, IDLE gives you the power 

to change how your code looks on screen. 


a ^ 




IDLE Preferences 


fncits/Tabs | Highlighting Kpysi fiF.ni 1 trail 
CusCom hlighlighling HighQighEmg Theme 

ScFecl : 

3L ftullr-lvi THpnv 

i) a Cusimm Thf mp 




Choose Colour for : 


Normal Tcki 




© Fop^gmund : 'J： S.irkgrmjrtd 


IDLF 


#yoo c-bji cLicjc horv 
#tO cklJUVU-i." ItUITA! 

do£ - 


Btrlnjg 1 

&ClOCtQ 4 ' 


i/orO 
i/MTl 


erreq cursor 

ihn ] 1 ntilftiJl 


nt.riirrr 


no custom ihc me g 


Delete Custom Theme 


!?.iw -i r . N'PW lihrmr 


Ok ) ( Apply ) ( Cancel ) ( Help 
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dealing with data 


Peal with complex data 

Any program of any worth that you create has to work with data. Sometimes, 
the data is simple and straightforward —— easy to work with. Other times, the 
data you have to work with is complex in its structure and meaning, forcing you 
to work hard to make sense of it all, let alone write code to process it. 


To tame complexity, you can often arrange your data as a list: there’s the list 
of customers, your friend’s list, the shopping list, and your to-do list (to name 
a few). Arranging data in lists is so common that Python makes it easy for you 
to create and process lists in code. 



Let’s look at some complex data before learning how to create and process list 
data with Python. 


A 時 W 


Ive been making lists of 
movie data for years and 
would love to be able to 
process it on my laptop... 


The si<t Manbj Pytlw" 

Ik Holy ^rail, I ">75, Teny Jexa i Terry $Hian, ^1 


M'uAael Palin, Cleex. Tory 4 ， llia», Brit MU ^ Ttt*y Jews 
The Ufe of Brijn, ITT}, Terry Jows, 竹 "iM 

Michael ftk John Cleex, Tory 剞 li»-, Erit l(M T^ry Jok. 


WtWlftkJolm Cl ⑽ Tq 钏 E 
TVtUfe»f Brta R , ITHi Teny Jo«s , 竹 


Michael Palin, John Cleese, Terry Bril Idle ? Teny Jones 


» Cleese, 

u(c, m. 


W, 101 


Thc\rc SUVC is 
a lot of dsis 

listed he 代 . 


T\)t Holy 6\ra\\, Tcv-v-y Jor>es f 7cv-v-y William ； mms 
graham Chapman 

Midhacl Palm, Johh Cleese, Terry 与 illiam, Ev-id Idle f 7ev-v-y Jo^cs 
The Li-Pe of \°C\% 7cv-v-y J OY\ts, mms 

A/Iidhacl Palm, Johh Cleese, 7ev-v-y William ； Ev-id Idle f 7cv-v-y Jor>es 
The McShi^ o-P Li-fe, 1^03, Tcv-v-y Jo^cs, lOl mihS 
The s\% /VJoh 七 y Py-thoh tas 七 members 

graham Chapman, Midhacl Palm, Johh C\tcsc, Tcv-vy William ； &rit Idle f Tev-vy Jor>cs 

TWis data is t。—W 


On first glance, this collection of data does indeed look quite complex. 
However, the data appears to conform to some sort of structure: there’s a line 
for a list of basic movie facts, then another line for the lead actor(s)，followed 
by a third line listing the movie’s supporting actors. 


This looks like a structure you can work with... 
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meet python 


Create simple Pythow lists 

Let’s start with the following simple list of movie titles and work up from 
there: 

The Holy 6\ra\\ 

The Li-fc of 


TV Li-fc ^ sV)0^rb \\si some 

Mo 灼七 Y woV,cs 



To turn the human-friendly list into a Python-friendly one, follow this four- 
step process: 


o 

❺ 

o 

o 


Convert each of the names into strings by surrounding the data with quotes. 


Separate each of the list items from the next with a comma. 


Surround the list of items with opening and closing square brackets. 

Assign the list to an identifier (movies in the preceding code) using the 
assignment operator (=)• 


It’s perfectly OK to put your list creation code all on one line, assuming, of 
course, that you have room: 



This wovks ； -too. 


you are here ► 








not my type 



Hang on a second! Aren't you 
forgetting something? DorVt you need to 
declare type information for your list? 


No, because Python’s variable identifiers 
don’t have a type. 

Many other programming languages insist that every 
identifier used in code has type information declared for 
it. Not so with Python: identifiers are simply names that 
refer to a data object of some type. 


Think of Python’s list as a high-level collection. The 
type of the data items is not important to the list. It’s 
OK to state that your movies list is a “collection of 
strings，” but Python doesn’t need to be told this. All 
Python needs to know is that you need a list, you’ve 
given it a name, and the list has some data items in it. 
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meet python 


Lists arc like arrays 

When you create a list in Python, the interpreter creates an array-like data 
structure in memory to hold your data, with your data items stacked from 
the bottom up. Like array technology in other programming languages, the 
first slot in the stack is numbered 0, the second is numbered 1, the third is 
numbered 2, and so on: 


TW»s 产 

6 odc 


lie 你养 O 





I 七 ew 非 I 


licm #Z 


-I- 


movies = ["The Holy Grail ", "The Life of Brian ", "The Meaning of Life 


TWis is yo^r w wov\cs 

|is*t 



Access list data using the square bracket notation 

As with arrays, you can access the data item in a list slot using the standard 
square bracket offset notation: 


daia i-tem 
^ "the list has a 

竹 umeiri 匕 OFFSET 

associated with it. 


Py 仏 starts to ⑽七 m 3 

-fv-ow ZjCVO. 


Pr 

y 

int (movies [1]) 
f\ 

- ► 

The Life of Brian 




K T 


Use VmtO ，， 腓 b ^ a 

data vbew o 的 street 


Wo suirpirisc heve, ^Ily.Mc 
^^ucs-tcd dais appcairs oh 


Let’s use IDLE to learn a bit about how lists work. 
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idle session 


m An IDLE Session - 

Lists in Python might look like arrays, but they are much more than that: they are full-blown Python collection 
objects. This means that lists come with ready-to-use functionality in the form of list methods. 

Let’s get to know some of Python’s list methods. Open up IDLE and follow along with the code entered at the »> 
prompt. You should see exactly the same output as shown here. 

Start by defining a list of names, which you then display on screen using the print () BIF. Then, use the len () 
BIF to work out how many data items are in the list, before accessing and displaying the value of the second data 
item: 


»> cast = [ "Cleese" , 'Palin', 'Jones', "Idle"] 
»> print (cast) 

['Cleese ', ' Palin', 'Jones', 'Idle'] 


»> print (len (cast)) 


4 


»> print (cast [1]) 


Its 伙伤 mvokc a 


Palin 


With your list created, you can use list methods to add a single data item to the end of your list (using the 
append () method), remove data from the end of your list (with the pop () method), and add a collection of 
data items to the end of your list (thanks to the extend () method): 


»> cast. append("Gilliam") 

»> print (cast) 

['Cleese', 'Palin', 'Jones', 'Idle 

»> cast .pop () 


- -/Wc-thods 3\rc ihvoked usiha ihe 

dommoh w w dot hotatioh. 

Gilliam'] 


Gilliam' 

»> print (cast) 

['Cleese ', 'Palin', 'Jones', 

»> cast. extend ([ "Gilliam ", 
»> print (cast) 

['Cleese ', 'Palin', 'Jones', 


'Idle'] 
Chapman"]) 



|Vs .Ws seated V] 

suv-v-ouy\dcd I07bvadkets. 


'Idle ', 'Gilliam ' r ' Chapman'] 


Finally, find and remove a specific data item from your list (with the remove () method) and then add a data item 
before a specific slot location (using the insert () method): 


»> cast. remove ("Chapman") 

»> print (cast) 

['Cleese', 'Palin', 'Jones', 'Idle ', ' Gilliam'] 
»> cast. insert (0 , "Chapman") 

»> print (cast) 

['Chapman ', ' Cleese ', 'Palin ', 'Jones', 'Idle', 


▼Gilliam' 


』 thai w C Ch d up with 
七 he ^asi o( yviohty py-th< 
Plyihg C\^[asI 


lOh s 
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meet python 


Add more data to your list 


With your list of movie names created, now you need to add more of the 
movie buff’s complex data to it. You have a choice here: 



Either strategy works. Which works best foryou depends on what you are 
trying to do. Let’s recall what the movie buff’s data looks like: 


i\\t yca^r »S 


The Holy irvy Jo«cs f 7cv-vy ^1 mins 

Chapman 

Midhacl Palm, Johh Cleese, 7ev-v-y William ； Ev-id Idle f 7cv-v-y Jo^cs 
The Li-fc yy Jones, ^ m'ms 

^vdhdnn Lhdpmdn 

—^ithacl Palm, Cleese, 7cv-vy 今 __"__ 扣 , Bvit Idle f Tcvvy Jo«cs 
The A1ca«iir>^ o^r L-i-fjT I cvv-y Jo«cs, lOl rw'ms 
The six /Vloniy PytKo« dast mc^bcv-s 

^v-ahaw> CKapw>a«, Midhael Palm, Joh« Cleese, Tcv-vy William, Bvid Idle f Tcv-vy Jones 


The next piece of data you need to add to your list is a number (which 
represents the year the movie was released), and it must be inserted after each 
movie name. Let’s do that and see what happens. 


you are here ► 
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mixed type 



No, not madness，just the way Python works. 

Python lists can contain data of mixed type. It’s perfectly OK 
to mix strings with numbers within the same Python list. In fact, 
you can mix more than just strings and numbers; you can store 
data of any type in a single list, if you like. 

Recall that a Python list is a high-level collection, designed from 
the get-go to store a collection of “related things.” What type 
those things have is of little interest to the list, because the list 
exists merely to provide the mechanism to store data in list form. 

So, if you really need to store data of mixed type in a list, 

Python won’t stop you. 
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meet python 



Let’s take a bit of time to try to work out which strategy to use when adding data to your list in 
this case. 

Given the following list-creation code: 



❶ Work out the Python code required to insert the numeric year data into the preceding list, 
changing the list so that it ends up looking like this: 



dodc 


❺ Now write the Python code required to re-create the list with the data you need all in one go: 


youv- 

V"C— 

^odc licirc. 




In this case, which of these two methods do you think is best? (Circle your choice). 

Q or ❺ 
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additional data 


BteRciSe 
SoLuiloH 


Let’s take a bit of time to try and work out which strategy to use when adding data to your list in 
this case. 

Given the following list-creation code: 



❶ You were to work out the Python code required to insert the numeric year data into the preceding 
list: 


I 咖七如 ycav 

BEFORE Sttoysd . 

、 movics.*msc\rtO, 1^75) 


l^scY'-i the sc^ohd ycav 

BBFORB ihe -fouv-th list iterh.- - > movics.'msevt^, I W <T" 


you get the math Haht? 

jist girows, so you have -fco iakc 
that ih-to ^Ohsidcira-tioh whch 
wo^rkihg out “cve "to do ihe 
sc^ohd ihscvt ， 


movies.appchd0^8^) 




丁 矸 ?— i c . last p k 
-bKc cy^a of ttdt" 


❺ You were also to write the Python code required to recreate the list with the data you need all in 
one go: 


Assia^ all vou^ data 

>/as »s 


movies =• C^Thc Holy 今 rail”, \°0^) 

W Thc Li-fc Bha〆' \°0% 
” The Life”, 


v-c^latcd* 


In this case, which of these two methods do you think is best? (You were to circle your choice.) 




Vcs, rnc^od r seems -bv.c fecUcv 
- o ? t»oy. «s, +0^ a small 

|*,s*t like tWis. Also , 七一 s ⑽ 
{x'\CV>j C.ouy\tm5 *to do. 
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meet python 


Work with your list data 


You often need to iterate over your list and perform some action on each item 
as you go along. Of course, it is always possible to do something like this, 
which works but does not scale.. 









This code works as expected, making the data from the list appear on screen. 
However, if the code is later amended to add another favorite movie to the list, 
the list-processing code stops working as expected, because the list-processing code 
does not mention the third item. 

Big deal: all you need to do is add another print () statement, right? 

Yes, adding one extra print () statement works for one extra movie, but 
what if you need to add another hundred favorite movies? The scale of the 
problem defeats you, because adding all those extra print () statements 
becomes such a chore that you would rather find an excuse not to have to do. 


It's time to iterate 


Processing every list item is such a common requirement that Python makes it 
especially convenient, with the built-in for loop. Consider this code, which is 
a rewrite of the previous code to use a for loop: 


Use w W’ & 

= 如 呼， ^ 

vaWc ok taeM 
• m dw\dua\ ov ^ 
sextt^ a s 7 0U X 、 




fav movies 


The Holy Grail", "The Life of Brian"] 


for each flick in fav movies : 1 丁七 he 

print (each—flick) | 乙 ode, a loop. 


Using a for loop scales and works with any size list. 
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list processing 


For loops work with lists of awy size 


Python’s for loop exists to process lists and other iterations in Python. Lists are 
the most common iterated data structure in Python, and when you need to 
iterate a list, it’s best to use for: 


TV kcvv/ovd w W’ 


ita 七 es 七 V 


mditatcs tV^c start 
i\\t loop ay>d 
behove 七 he 
-tav-yt idcyrbfid 

for 


The kcyy/ov-dl w *m w separates 
七 he ide 的七 i*fic\r -fvom 

youv list 



■ 


in 




TV.C U^ottsi^oAt 

MUST 

^ \oo V - 



A ^oloh M,w -follows youv 
list y\^n\c 9v\d ihd.u^tes 
七 he 七 youv* list— 
piro^ssmg Code. 



The list-processing code is referred to by Python programmers as the suite. 

The target identifier is like any other name in your code. As your list is 
iterated over, the target identifier is assigned each of the data values in your 
list, in turn. This means that each time the loop code executes, the target 
identifier refers to a different data value. The loop keeps iterating until it 
exhausts all of your list’s data, no matter how big or small your list is. 

An alternative to using for is to code the iteration with a while loop. 
Consider these two snippets of Python code, which perform the same action.. 


V\A>c 扒 Y ou uSC } 

you V^avc *bo >wo\r\rY about 
w s*ta 七 e 'm-fo\rwatioy\, 

V/WlCA) VC^'V'CS Y ou ^ 

•to emfloY d ^ 

•idevrbLd - 




count = 0 

while count < len(movies) : 
print(movies[count]) 
count = count+1 



These while and for statements do the same thing. 


— 

for each 一 item in movies : 
print(each item) 

1 - 1 ^ 1 

V. you use -the 

Pythoh ihicirp^c-tcv- 
v^rri« abou-t the {i siaie 
ih^fovmatioh” <fov you. 
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tWeiqre no ^ 

Dumb Questi9ns 


So...when iterating over a list, I 
should always use for instead of while? 

Yes, unless you have a really good 
reason to use (or need the extra control 
of) a while loop. The for loop takes care 
of working from the start of your list and 
continuing to the end. It’s next to impossible 
to get stung by an off-by-one error when you 
use for. This is not the case with while. 

So, lists aren’t really like arrays 
then, because they do so much more? 

Well...they are in that you can access 
individual data items in your list with the 
standard square bracket notation, but—as 
you’ve seen—Python’s lists can do so much 
more. At Head First Labs, we like to think of 
lists as “arrays on steroids." 

Q/ And they work this way only in 
Python 3, right? 

No. There are certain enhancements 
to lists that were added in Python 3, but 
release 2 of Python has lists, too. All of what 
you’ve learned about lists so far will work 
with lists in Releases 2 and 3 of Python. 

Q/ Why are we using Python 3? What’s 
wrong with Python 2, anyway? Lots of 
programmers seem to be using it. 

Lots of programmers are using Python 
2, but the future of Python development lies 
with Release 3. Of course, moving the entire 
Python community to Python 3 won’t happen 
overnight, so there’s an awful lot of projects 
that will continue to run on Release 2 for the 
foreseeable future. Despite 2’s dominance 
at the moment, at Head First Labs we think 
the new bits in 3 are well worth the added 
investment in learning about them now. 

Don’t worry: if you know 2, Python 3 is easy. 


Seeing as Python’s lists shrink and 
grow as needed, they must not support 
bounds-checking, right? 

Well, lists are dynamic, in that they 
shrink and grow, but they are not magic, 
in that they cannot access a data item 
that does not exist. If you try to access a 
nonexistent data item, Python responds with 
an 工 ndexError ， which means “out of 
bounds.” 

What’s with all the strange 
references to Monty Python? 

Ah, you spotted that, eh? It turns 
out that the creator of Python, Guido van 
Rossum, was reading the scripts of the 
Monty Python TV shows while designing his 
new programming language. When Guido 
needed a name for his new language, he 
chose “Python” as a bit of a joke (or so the 
legend goes). 

Do I need to know Monty Python in 
order to understand the examples? 

No, but as they say in the official 
Python documentation: “it helps if you do.” 
But don’t worry: you’ll survive, even if you’ve 
never heard of Monty Python. 

I notice that some of your strings 
are surrounded with double quotes and 
others with single quotes. What’s the 
difference? 

There isn’t any. Python lets you use 
either to create a string. The only rule is that 
if you start a string with one of the quotes, 
then you have to end it with the same 
quote; you can’t mix’n’match. As you may 
have seen, IDLE uses single quotes when 
displaying strings within the shell. 


What if I need to embed a double 
quote in a string? 

You have two choices: either escape 
the double quote like this: \ ", or surround 
your string with single quotes. 

Can I use any characters to name 
my identifiers? 

No. Like most other programming 
languages, Python has some rules that 
must be adhered to when creating names. 
Names can start with a letter character or 
an underscore, then include any number 
of letter characters, numbers, and/or 
underscores in the rest of the name. Strange 
characters (such as %$£) are not allowed 
and you’ll obviously want to use names that 
have meaning within the context of your 
code. Names like members, the_ 
time , and people are much better 
than m, t, and p, aren’t they? 

Yes, good naming practice is 
always important. But what about case 
sensitivity? 

Yes, Python is the “sensitive type,” in 
that Python code is case sensitive. This 
means that msg and MSG are two different 
names, so be careful. Python (and IDLE) 
will help with the problems that can occur as 
a result of this. For instance, you can use 
an identifier in your code only if it has been 
given a value; unassigned identifiers cause 
a runtime error. This means that if you type 
mgs when you meant msg, you’ll find out 
pretty quickly when Python complains about 
your code having a NameError. 


you are here ► 
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lists within lists 


Store lists withiw lists 


As you’ve seen, lists can hold data of mixed type. But it gets even better than 
that: lists can hold collections of anything, including other lists. Simply embed 
the inner list within the enclosing list as needed. 

Looking closely at the movie buff’s data, it is possible to determine a structure 
which looks much like a list of lists: 


Tlicvc s ohly ohc lead 

listed bui 
Could be 




...y/hidh i*Ucl-f doirrta’ms 
a lis*t o-f lead a^*tov-s..! 



TKc Holy ^vail, 1 巧 1 弓 , Tcvvy Jor\cs f Tcvvy William ； mms 

Mi^Kad Palm, JoVm Cleese Tcvvy ^illiam ； £vid Idle f Tcvvy Jones 



...whulh itscl-f 
^oh-bihs a list Jc 
suppov-tihg a^-tovs. 


In Python, you can turn this real list of data into code with little or no effort. 
All you need to remember is that every list is a collection of items separated 
from each other with commas and surrounded with square brackets. And, of 
course, any list item can itself be another list: 



T\\t s*tav-t 

ou*tcv* list 


- 1 - 


movies 




The Holy Grail ", 1975, "Terry Jones & Terry Gilliam ", 91, 
["Graham Chapman ", 

"John Cleese ", "Terry Gilliam"," 


The chd of all the 

lists is hcv-c. 


["Michael Palin' 


Eric Idle 1 


Terry Jones"]]] 


TV sia^ri o( the 

sedohd ； ihhCV* list ： 

W movi « [午 


TV>c start 乂 如 

\Y\Y\&r \\sb Vovies [ 今 ] [I] 



So, a list within a list is possible, as is a list within a list within a list (as this 
example code demonstrates). In fact, it’s possible to nest lists within lists to 
most any level with Python. And you can manipulate every list with its own list 
methods and access it with the square bracket notation: 


This looks a little wcMrd...uhti| you 

TV so W 

also be xhlrcc ^losihg ohes. 




print(movies[4][1][3]) 

_ 


Eric Idle 




/\ \\si VrtWm a hs 七 Wi-bWm a list 


is this deeply h«tcd, so he 
匕扣七 possibly be idle. © 
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meet python 


t An IDLE Session 


Creating a list that contains another list is straightforward. But what happens when you try to process a list that 
contains another list (or lists) using the for loop from earlier in this chapter? 

Let’s use IDLE to work out what happens. Begin by creating the list of the movie data for "The Holy Grail” in 
memory, display it on screen, and then process the list with your for loop: 

»> movies = ["The Holy Grail" , 1975 , "Terry Jones & Terry Gilliam" , 91, 

["Graham Chapman ", ["Michael Palin ", "John Cleese ", 

"Terry Gilliam ", "Eric Idle ", "Terry Jones”]]] 

»> print (movies) 

['The Holy Grail', 1975 , ' Terry Jones & Terry Gilliam' , 91, ['Graham Chapman' , ['Michael Palin' , 

Eric Idle 1 , 'Terry Jones']]] 

TV^C list a list 如七 Wm 

a \\si seated m 


'John Cleese ', 'Terry Gilliam 

»> for each_item in movies : 
print(each item) 


The Holy Grail 
1975 

Terry Jones & Terry Gilliam 
91 

['Graham Chapman ', ['Michael Palin 


The U -fo\r W loop eadh iicm o( 

the ou-tev- loop OblLs/. 


'John Cleese ', 'Terry Gilliam ', 'Eric Idle ', 'Terry Jones 1 ]] 


TKc iymcv* lis*t nrmCV" lis*t is pv'm*tcd as—is. 



Your for loop is working OK. I think the 
trouble is that you haven’t told it what to 
do with any inner lists that it finds, so it 
just prints everything, right? 


Yes, that’s correct: the loop code isn’t complete. 

At the moment, the code within the loop simply prints each list 
item, and when it finds a list at a slot, it simply displays the entire 
list on screen. After all, the inner list is just another list item as far as 
the outer enclosing list is concerned. What’s we need here is some 
mechanism to spot that an item in a list is in fact another list and take 
the appropriate action. 

That sounds a little tricky. But can Python help? 
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19 








looking for lists 


Check a list for a list 


Each time you process an item in your list, you need to check to see if the 
item is another list. If the item is a list, you need to process the nested list 
before processing the next item in your outer list. Deciding what to do when in 
Python follows the familiar if... else... pattern: 




key 如 ov< 

ta 七 cs 七 V 


md'itatcs start 

o-f i\\t AtC：\s：\or\ Code 


A to\oy\ (0 -follows youv- 
^Ohdrtioh ics-i ， 


、if 




else : 



Look/ doloK). 


y his 4 心 diii 

docs HOT hold U, \i l s FALSE). 



|\(o*tc : bo*bV) suites 
avc mdcy\*bcd- 


No surprises here, as the if statement in Python works pretty much as 
expected. But what condition do you need to check? You need a way to 
determine if the item currently being processed is a list. Luckily, Python ships 
with a BIF that can help here: isinstance (). 

What’s cool about the isinstance () BIF is that it lets you check if a 
specific identifier holds data of a specific type: 


Circatc d shov-t list 3 hd 
toijh it io idehti^iev. 


/\sk i-f is 3 |is*t fi*t is). 


d {p 


/An IDLE Session 


Let’s use the IDLE shell to learn a little about how isinstance () works: 



»> names = [' Michael' , ' Terry ▼] 

»> isinstance (names , list) 

True 

»> num names = len (names) 


Vist (vt • ⑼ ’ W. 


»> isinstance (num_names , list) 
S a ^ - ^False 


Rc-fc\r -bo a 

k *bw>s tasc, 

\s 
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meet python 



Here’s a copy of the current list-processing code. Your task is to rewrite this code using an if 
statement and the isinstance () BIF to process a list that displays another list. 


for each—item in movies : 
print(each item) 


lAMte 70UV 

todt . — ^ 


D 


tJiereiar 

>umb 


e ng o 

Questi9ns 


Are there many of these BIFs in 
Python? 

Yes. At the last count, there were over 
70 BIFs in Python 3_ 

Over 70! How am I to remember 
that many, let alone find out what they all 
are? 

You don’t have to worry about 
remembering. Let Python do it for you. 


Qj How? 

At the Python or IDLE shell, type 

dir (_builtins _) to see a list 

of the built-in stuff that comes with Python 
(that’s two leading and trailing underscore 
characters, by the way). The shell spits 
out a big list. Try it. All those lowercase 
words are BIFs. To find out what any BIF 
does—like input (), for example—type 
help (input) at the shell for a 
description of the BIFs function. 


Why so many BIFs? 


Why not? Because Python comes with 
lots of built-in functionality, it can mean less 
code for you to write. This Python philosophy 
is known as “batteries included”: there’s 
enough included with Python to let you do 
most things well, without having to rely on 
code from third parties to get going. As well 
as lots of BIFs, you'll find that Python’s 
standard library is rich and packed with 
features waiting to be exploited by you. 
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list the list 


toRctSe 

SotiiivoH 


Here’s a copy of the current list-processing code. Your task was to rewrite this code using an if 
statement and the isinstance () BIF to process a list that displays another list. 


Pv-otcss W W 0 VICS 

list as fec-fo\TC. 


for each—item in movies 
print(each item) 


You b> dhcdk i-f 
duv*v*cir>*t • 七 dis a 


-for movies ： 

- i-f isms*tahde(eadh_i*tem, lis*t): 


The ihhev- loop 

d hew -t^vact 
idch-ti-picv. 


-for hcs*tcd i*tcn« m eddh 


l*f _七 is a list use a^oihev_ 

tiJrit ?}rouss ^ ^ ^ic^siedji^) 


else ： 


Did you mdhdgc -to get youv- 
i^dch"tci-tioh vight? r . r 







i\\t tuv-v-cir\*t rtew 
of {\\t c^C-losm^ list 
\ a list disf lay \i 

ov\ sCrccw 


W An IDLE Session - 

Let’s use IDLE to see if this code makes a difference to the output displayed on screen: 

»> for each_item in movies : 

if isinstance(each—item, list) : 
for nested_item in each_item: 
print (nested_item) 

else : 

print(each_item) 

The Holy Grail 
1975 

Terry Jones & Terry Gilliam 
91 

Graham Chapman 

['Michael Palin', 'John Cleese', 'Terry Gilliam', 'Eric Idle ^, 'Terry Jones A ] 


TV^is »s a IvWJc fee 七 W, W 七⑽卞 
栋 a 七 , s d k 叫 ^ oUsstA 。 ㈣ 丫 
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meet python 


Complex data is hard to process 


The movie buff’s data is complex. Let’s take another look at a subset of the 
data and your Python code that processes it. 


TV outc^r, C^losm^ \\si 


TV^c data 




Holy Tcvvy Jo^cs f Tcvvy 

CKafmag> 



idKad Palm, JoVm Cleese, Tcvvy £vid Idle f 


h mheir, nested list 


ty\0*t^cv- \v\Y\tr (my\CV-), 


Pvodcss *thc ou*tcv-, cir>dlos*m^ list 





C^or each _item in movie 》： 

if isinstance(each item, list) : 



[or nested 一 item in each item 
print(nested item) 


else : 


print(each item) 




Can you spot the problem with your Python 
code as it is currently written? What do you 
think needs to happen to your code to allow it to 
process the movie buff’s data correctly? 



Yeah., thafs almost 
working...ifs just a 
pity about that list of 
supporting actors... 
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nested lists 


Handle many levels of nested lists 

The data and your code are not in sync. 

The movie buff’s data is a list that contains a nested list that itself contains 
a nested list. The trouble is that your code knows only how to process a list 
nested inside an enclosing list. 

The solution, of course, is to add more code to handle the additionally nested list. By 
looking at the existing code, it’s easy to spot the code you need to repeat: 


for each item in movies : 


丁 Wis to&t 
pvotcsscs 3 



isinstance(each—item, list) : 
for nested 一 item in each item 
print(nested item) 


print(each—item) 



TV 於 % 七 

iWaticm d 7 ouV， 

todc looks like 

七 Wis. 


WevVs whcv-c the 

todt heeds 

■to 30 . 




for each—item in movies : 

if isinstance(each item, list) : 

^ 一 

for nested item in each item: 


|\(o 七 c: m 仏 |S 
CoAt) 

weeds a 扒 

associated 



Th ^ toA t 

{h c 

〜 — idc ^ 

3l,cd 
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meet python 


^ / An 


IDLE Session 


Let’s use IDLE once more to test this latest iteration of your code: 


»> for each_item in movies : 


if isinstance(each_item, list) : 
for nested_item in each_item: 

if isinstance(nested_item, list) : 
for deeper_i tem in nes ted_i tem : 
print (deeper_i tem) 

else : 

print(nested_item) 

else : 

print(each item) 



.5? 遂 


The Holy Grail 
1975 

Terry Jones & Terry Gilliam 
91 

Graham Chapman 
Michael Palin 
John Cleese 
Terry Gilliam 
Eric Idle 
Terry Jones 


$ 


ft woirks/ This time, y ou 
see all youv list 

Oh 



I just love that...in fact, I love it so 
much I've decided to add another list to my 
data. I want to include the other movies each 
supporting actor has starred in. If I add the 
data, can you change your code to print this 
data, too? 


That’s more list data and more Python code. 

The data has to be embedded as another nested list within the already deeply 
nested list of supporting actors. That’s possible to do, even though it makes 
your head hurt just to think about a list of lists of lists of lists! Amending your 
code is just a matter of adding another for loop and an if statement. 


That doesn’t sound like too much trouble, does it? 
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avoid complexity 



I think rd rather have a root canal 
than change that code again. 


Adding another nested loop is a huge pain. 

Your data is getting more complex (that mind-bending list 
of lists of lists of lists) and, as a consequence, your code is 
getting overly complex, too (that brain-exploding for loop 
inside a for loop inside a for loop). And overly complex 
code is rarely a good thing... 
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meet python 



Wouldn’t it be dreamy if there were an 
efficient way to process lists, preferably 
using a technique that resulted in less code, 
not more? But I know ifs just a fantasy... 
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reduce, reuse, recycle 


Pow’t repeat code; create a fuwctiow 


Take a look at the code that you’ve created so far, which (in an effort to save 
you from hdmngyour brain explode) has already been amended to process 
another nested list. Notice anything? 


TV’s todt is essehtially ihe 
! same as this Code... 



...y/WWis cssc^ally 
sa^c as -bWis 


item 


for deeper—item in nested^ 

isinstance(deeper item. 



if 


list) 


for 


deepest 一 item in deeper_item : 
print (deepe s t_i tem ； 


… whi 乙 h is ⑽乇 

this dodc. 


else : 


else : 


else : 


print (nes ted—item) 


print(deeper item) 

丁 Vive’s 於 o*t 







print(each item) 





This Code is -fco gei a little s 匕 avy … 


Your code now contains a lot of repeated code. It’s also a mess to look at, even 
though it works with the movie buff’s amended data. All that nesting of for 
loops is hard to read, and it’s even harder to ensure that the else suites are 
associated with the correct if statement. 

There has to be a better way.. .but what to do? 

When code repeats in this way, most programmers look for a way to take 
the general pattern of the code and turn it into a reusable function. And 
Python programmers think this way, too. Creating a reusable function lets 
you invoke the function as needed, as opposed to cutting and pasting existing 
code. 


So, let’s turn the repeating code into a function. 
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meet python 


Create a function m Pythow 

A function in Python is a named suite of code, which can also take an optional 
list of arguments if required. 


You define a Python function using the def statement, providing a name 
for your function and specifying either an empty or populated argument list 
within parentheses. The standard form looks something like this: 


TV 

'm*tv-odutcs i\\t 扒 awe 

o-f 七 he 

^^def 



lists arc optional, 

but parentheses arc NOT. 





卜 



A to\oy\ (：) -follows "the 
^losih^ p^vchthcsis 
ahd ihdi^ol-tcs ihc 
七 youv* 

-Puh^tiohs todt suite. 



What does your function need to do? 

Your function needs to take a list and process each item in the list. If it finds a 
nested list within the first list, the function needs to repeat. It can do this by 
invoking itself on the nested list. In other words, the function needs to recur —— 
that is, invoke itself from within the funtion code suite. 


Let’s call the function that you’ll create print_lol (). It takes 
one argument: a list to display on screen. Grab your pencil and 
complete the code below to provide the required functionality: 

def print—lol(the_list) : 


Y^Sharpen your pencil 


for 

if 


else : 
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recursive function 


^ Sharpen your pencil 

Solution 



You were to call the function that you’ll create print_lol (). It 
takes one argument: a list to display on screen. You were to grab your 
pencil and complete the code to provide the required functionality: 


def print lol(the list) : 


P\rotcss i\\t Pvovidcd 

list a lo。?. 


for 


"the item bcihg pressed 

*' s 如以 a lisi ihvokc the 
TUh^-tioh. 


p\rm*t 」 ol(ea 6 h_i*tem) 



else : 




/ 


|-f -tKc rtew be … 5 pv •。“ ssc d T 

a list dis^laY 


p / An IDLE Session 


Let’s use IDLE one final time to test your new function. Will it work as well as your earlier code? 


»> def print 一 lol (the_list): 

for each—item in the_list: 

if isinstance(each_item, list) : 
print 一 lol (each_item) 

else : 

print(each item) 


Pc-f'mc { ⑽出 o”. 


»> print 一 lol (movies) 

The Holy Grail 
1975 

Terry Jones & Terry Gilliam 
91 

Graham Chapman 
Michael Palin 
John Cleese 
Terry Gilliam 
Eric Idle 
Terry Jones 


Invoke the -fuh^tioh. 





iOh 


吒 Dorics, {p 0 \ The v-c^usv-ivc Wtu 
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meet python 


Recursion to the rescue! 


The use of a recursive function has allowed you to reduce 14 lines of messy, 
hard-to-understand, brain-hurting code into a six-line function. Unlike the 
earlier code that needs to be amended to support additional nested lists 
(should the movie buff require them), the recursive function does not need to 
change to process any depth of nested lists properly. 


Python 3 defaults its recursion limit to 1,000, which is a lot of lists of lists of lists 
of lists" .and this limit can be changed should you ever need even more depth 
than that. 


What a great start! 



Ah, yes, thafs terrific! I can now 
relax, knowing that your code can 
process my movie data. I really 
shouldVe done this years ago... 


By taking advantage of functions and recursion, you’ve solved the code 
complexity problems that had crept into your earlier list-processing code. 

By creating print_lol (), you’ve produced a reusable chunk of code that 
can be put to use in many places in your (and others) programs. 


You’re well on your way to putting Python to work! 
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python toolbox 



Your Pythow Toolbox 

You’ve got Chapter 1 under your 
belt and you’ve added some key 
Python goodies to your toolbox. 


❹ W BIF - a Wil 七 -… WW 
• - a blodk <^f Pyt^o^ 6odc, 

\S mdc^cd ^ yro^ 

备 w BaUcr\cs \uWdtA" - a v/ay 
rcW*m3 ^ Ui domes 

most cvcv-YtWi^ you II ^cd 
—吒 c^AIy ^odudlwclY- 


II)UB l^oies 

^ The IDLE shell Uis you cxpcHmcht wi ^ 
y ⑽ r todt as you wviic ii 

參 Adjust IDLB’s pvc-fcirch^s -to suit -the 
way you wo\rk. 

^ ^T.r^ whch _ kih 3 …••仏心 swi, 

r m & P ^ vious use Alt-K U 

"ext fbut use Ctvl i*f you% 0h a ■) 



BULLET POINTS - 

■ Run Python 3 from the command line or 
from within IDLE. 

■ Identifiers are names that refer to data 
objects. The identifiers have no “type，” but 
the data objects that they refer to c/o. 

■ print () BIF displays a message on 
screen. 

■ A list is a collection of data, separated 
by commas and surrounded by square 
brackets. 

■ Lists are like arrays on steroids. 

■ Lists can be used with BIFs, but also 
support a bunch of list methods. 

■ Lists can hold any data, and the data can be 
of mixed type. Lists can also hold other lists. 

■ Lists shrink and grow as needed. All of the 
memory used by your data is managed by 
Python for you. 

■ Python uses indentation to group statements 
together. 

■ len () BIF provides a length of some data 
object or count the number of items in a 
collection, such as a list. 

■ The for loop lets you iterate a list and 
is often more convenient to use that an 
equivalent while loop. 

■ The if … else... statement lets you make 
decisions in your code. 

■ isinstance () BIF checks whether 
an identifier refers to a data object of some 
specified type. 

■ Use def to define a custom function. 
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2 scaring your code 


參 Modules of functions ♦ 



Reusable code is great, but a shareable module is better. 

By sharing your code as a Python module, you open up your code to the entire Python 
community...and it’s always good to share, isn't it? In this chapter, you’ll learn how to 
create, install, and distribute your own shareable modules. You’ll then load your module 
onto Python’s software sharing site on the Web, so that everyone can benefit from your 
work. Along the way, you’ll pick up a few new tricks relating to Python’s functions, too. 


this is a new chapter 
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let’s share 


If s too good wot to share 

You’ve been showing your function to other programmers, and they like what 
they see. 



Yes, a function this good should be shared with the world. 

Python provides a set of technologies that make this easy for you, which 
includes modules and the distribution utilities: 

O Modules let you organize your code for optimal sharing. 

籲 The distribution utilities let you share your modules with the world. 

Let’s turn your function into a module, then use the distribution utilities to 
share your module with the wider Python programming community. 
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sharing your code 


Turw your fuwctiow into a module 

A module is simply a text file that contains Python code. The main 
requirement is that the name of the file needs to end in . py: the Python 
extension. To turn your function into a module, save your code into an 
appropriately named file: 


YouV" to&t 
-f\row 



def print 一 lol(the_list): 

for each_item in the_list: 

if isinstance(each_item, list) : 
print 一 lol (each_item) 

else : 

print (each_item) 

— 



tWeiqre no ^ 

Dumb Questions 


Lei’s 匕 all 
"this -pile 


U 






What’s the best Python editor? 


The answer to that question really depends on who you ask. However, you 
can, of course, use any text editor to create and save your function’s code in a 
text file. Something as simple as NotePad on Windows works fine for this, as does 
a full-featured editor such as TextMate on Mac OS X. And there’s also full-fledged 
IDEs such as Eclipse on Linux, as well as the classic vi and emacs editors. And, 
as you already know, Python comes with IDLE, which also includes a built-in 
code editor. It might not be as capable as those other “real” editors, but IDLE is 
installed with Python and is essentially guaranteed to be available. For lots of 
jobs, IDLE’s edit window is all the editor you’ll ever need when working with your 
Python code. Of course, there are other IDEs for Python, too. Check out WingIDE 
for one that specifically targets Python developers. 



Go ahead and create a text 
file called nester . py that 
contains your function code 
from the end of Chapter 1. 
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modules repository 


Modules arc everywhere 

As might be expected, you’ll find Python modules in lots of places. 


Tm preloaded with 
lots of modules in the 
Python Standard Library... 
and they are already on your 
computer. 


o 


python 


lm 


mmmmm 



\ 

The Python Package Index (or PyPI for short) provides a 
centralized repository for third-party Python modules on the 
Internet. When you are ready, you’ll use PyPI to publish your 
module and make your code available for use by others. And your 
module is ready, but for one important addition. 

What do you think is missing from your module? 


If the Standard Library doesn't do 
it for you, why not try the Web? 

I hear PyPI is where third-party 
Python modules hang out. 


O 



Gee| Bits 


If you are already familiar with 
Perl’s CPAN repository, you can 
think of PyPI as the Python 
equivalent. 
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sharing your code 


Comment your code 


It’s always a good idea to include comments with your code. As your plan to 
share your module with the world, well-written comments help to document 
your work. 

In Python, a common commenting technique is to use a triple quote for 



Y^Sharpen your pencil 


Pui y°^ module 

hew. 



Here is your module code (which is saved in the file nester . py). In 
the spaces provided, use your pencil to compose two comments: the 
first to describe the module and the second to describe the function. 


def print—lol(the—list): 


Add a 



for each—item in the—list: 

if isinstance(each—item, list) 
print_lol(each—item) 

else : 

print(each—item) 


you are here ► 


37 






















request for comments 

^ Sharpen your pencil 

Solution 



Here is your module code (which is saved in the file nester . py). In 
the spaces provided, you were asked to use your pencil to compose 
two comments: the first to describe the module and the second to 
describe the function. 


_ ^ uuw This is u r\estev-.py ,； module, i*b provides oy\c -fuhd-tio^ tailed 

f whidh pr*m*b lists *tha 七 nr\ay o\r may ho*t mdude r\cs*tcd lis*ts ’’ 卵 

p\d '/ ou def print—lol (the—list): 

VCwCwVjCV 1 vX> 

mdludc *tV>c *tv"»v t _This -bakes a posi*tiohal called w *the 一 list' whidh is a^y 

fU s . Python list (o^i possibly, nested lists). Eddh dd4d iicm *m {\\t provided list 

is (recursively) p\r*m*tcd bo ov\ i*ts ovm 

for each—item in the—list: 

if isinstance(each—item, list) : 

prin t_lol (each—item) ^ 丁^代 a 代⑽ 

else: atW code youVc just 

print (each—item) dddi^5 sowC towwCyrU* 


How do I know where the Python 
modules are on my computer? 

Ask IDLE. Type import sys; 
sys . path (all on one line) into the IDLE 
prompt to see the list of locations that your 
Python interpreter searches for modules. 

Hang on a second. I can use to 
put more than one line of code on the 
same line in my Python programs? 

Yes, you can. However, I don’t 
recommend that you do so. Better to give 
each Python statement its own line; it makes 
your code much easier for you (and others) 
to read. 



Does it matter where I put my 
nester. py module? 

For now, no. Just be sure to put it 
somewhere where you can find it later. In 
a while, you’ll install your module into your 
local copy of Python, so that the interpreter 
can find it without you having to remember 
when you actually put it. 

So comments are like a funny- 
looking string surrounded by quotes? 

Yes. When a triple-quoted string is 
not assigned to a variable, it’s treated like a 
comment. The comments in your code are 
surrounded by three double quotes, but you 
could have used single quotes, too. 


Is there any other way to add a 
comment to Python code? 

Yes. If you put a T symbol anywhere 
on a line, everything from that point to the 
end of the current line is a comment (unless 
the T appears within a triple quote, in 
which case it’s part of that comment). A lot 
of Python programmers use the T symbol 
to quickly switch on and off a single line of 
code when testing new functionality. 
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sharing your code 


r \^ / An IDLE Session 



Now that you’ve added your comments and created a module, let’s test that your code is still working properly. 
Rather than typing your function’s code into IDLE’s prompt, bring the nester . py file into IDLE’s edit window, 
and then press F5 to run the module’s code: 


Co\or 6odcd- 一 




nester.py - /Users/barryp/HeadFirstPython/chapter2/nester.py 


"""This is the "nester.py" module and it provides one function called print_lol() 
which prints lists that may or may not include nested lists.""" 

def print lol(thelist) : 

"""This function takes one positional argument called "the_list", which 

is any Python list (of - possibly - nested lists). Each data item in the 
provided list is (recursively) printed to the screen on it # s own line.""" 

for each 一 item in the_list: 

if isinstance (each_item, list) ; 

printlol(each~item) 
else : 

print (each_item) 



Nothing appears to happen, other than the Python shell "restarting” and an empty prompt appearing: 


»> ================================ RESTART 

»> 

»> 


What’s happened is that the Python interpreter has reset and the code in your module has executed. The code 
defines the function but, other than that, does little else. The interpreter is patiently waiting for you to do 
something with your newly defined function, so let's create a list of lists and invoke the function on it: 

»> movies =[ 

"The Holy Grail ", 1975 , "Terry Jones & Terry Gilliam ", 91 
["Graham Chapman ", 



["Michael Palin ", "John Cleese ", "Terry Gilliam ", "Eric Idle ", "Terry Jones"]]] 


»> print_lol (movies) 
The Holy Grail 


Invoke the -Puh^tioh oh the list. 


1975 

Terry Jones & Terry Gilliam 
91 

Graham Chapman 
Michael Palin 
John Cleese 
Terry Gilliam 
Eric Idle 
Terry Jones 


Cool Vouv todt toy>*t'mucs 

as TV^c data 

m \\si lists »s 

ov\ s£.v-ccy\. 
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distribution plan 


Prepare your distribution 


In order to share your newly created module, you need to prepare a 
distribution. This is the Python name given to the collection of files that 
together allow you to build, package, and distribute your module. 

Once a distribution exists, you can install your module into your local copy 
of Python, as well as upload your module to PyPI to share with the world. 
Follow along with the process described on these two pages to create a 
distribution for your module. 



Begin by creating a folder for your module. 

With the folder created, copy your nester . py module file into the 
folder. To keep things simple, let’s call the folder nester: 


module -f ile- 





Follow along with each of 
the steps described on these 
pages. By the time you reach 
the end, your module will 
have transformed into a 
Python distribution. 



newly tYtaitd 
VsW -foldcv (ov 



Create a file called ''setup.py" in your new folder. 

This file contains metadata about your distribution. Edit this file by adding the following code: 


Import 

-fv-ow Py^o^s 

七 utilities. 




These the 

setup *Puh 匕 tioh’s 

airgumch-t hames. 


from distutils•core import setup 


setup( 


name 
version 
py— modules 
author 


='nester', 
='1.0.0', 

=['nester'] 


Associate youv module^ 
with the setup 

TUh^tioh s 




='hfpython', 

author 一 email = 'hfpythonQheadfirstlabs.com', 
url = 'http://www.headfirstlabs.com', 

description = 'A simple printer of nested lists', | Vouv 

^ I will be di-Pfcvcht. 


These avc the 
values Head Fwrsi 

^^ r - Labs use with 

\ I theiv- modules； 
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sharing your code 


Puild your distribution 


You now have a folder with two files in it: your module’s code in nester . py 
and metadata about your module in setup . py. Now, it’s time to build your 
distribution. 




^ Build a distribution file. 

The distribution utilities include all of the smarts required to build a distribution. Open a terminal 
window within your nester folder and type a single command: python3 setup.py sdist. 

Ehtcv - 七 he ,— _ 

u I File Edit Window Help Build 

匕 Ommahd at 

"the pv-ompt 


$ python3 setup.py sdist 
running sdist 
running check 

warning : sdist: manifest template 'MANIFEST.in' does not exist 

warning : sdist: standard file not found: should have README 

writing manifest file 'MANIFEST' 

creating nester-1.0.0 

making hard links in nester-1.0.0... 

hard linking nester.py -> nester-1.0.0 

hard linking setup.py -> nester-1.0.0 

creating dist 

Creating tar archive 

removing 1 nester-1.0.0' (and everything under it) 


toilet 七 i 。 灼 d 
status wessays 

OY\ SCXttY\) 

toyv-f 七 he 

of Y ou，r 

(Jis*brUio 灼 . 



o Install your distribution into your local copy of Python. 

Staying in the terminal, type this command: sudo python3 setup . py install. 


Ahothcv buh 匕 h 

status messages 
dppcair oh 
^oh+iv-mihg the 
i I |^i oh o-(* 

yowr distiributioh. 


File Edit Window Help Install 


$ python3 setup.py install 

running install 

running build 

running build_j>y 

creating build 

creating build/lib 

copying nester.py -> build/lib 

running install 一 lib 

copying build/lib/nester.py -> /Library/Frameworks/Python. 
framework/Versions/3.l/lib/python3.1/site-packages 
byte-compiling /Library/Frameworks/Python.framework/Versions/3•1/ 
lib/python3.1/site-packages/nester.py to nester.pyc 
running install— egg 一 info 

Writing /Library/Frameworks/Python.framework/Versions/3.1/lib/ 
python3.1/site-packages/nester-l.0.0-py3.1.egg-info 




Your distribution is ready. 
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ready for distribution 


A quick review of your distribution 


Thanks to Python’s distribution utilities, your module has been transformed into 
a distribution and installed into your local copy of Python. 


You started with a single function, which you entered into a file called 
nester . py, creating a module. You then created a folder called nester 
to house your module. The addition of a file called setup . py to your 
folder allowed you to build and install your distribution, which has resulted 
in a number of additional files and two new folders appearing within 
your nester folder. These files and folders are all created for you by the 
distribution utilities. 


Before Setup 



After Setup 



MANIFEST 


A list -files ih 
y ou,r distiribu-tioh is 
ih this -file. 



setup.py 


Youv 

m *bWis -f ile- 



Vouv Codt is ih 

this (ile. -- 


Hcv-c av-c vouv- 



nester.py 


nester.pyc 
setup.py 


Youv _ ^ 

*m *tWis -f ile- 



A Yompiled” vcvsioh 
youv* 匕 ode is ih 
"this -file. 
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sharing your code 


Import a module to use it 

Now that your module is built, packaged as a distribution, and installed, let’s 
see what’s involved in using it. To use a module, simply import it into your 
programs or import it into the IDLE shell: 


Use 



import nester 





“ahd provide -the hdme 
youv- module. 


Note: Y 0VA do 於七 y^ccd *to 

rntludc d” 

70UV module. 


The import statement tells Python to include the nester . py module in 
your program. From that point on, you can use the module’s functions as if 
they were entered directly into your program, right? Well.. .that’s what you 
might expect. Let’s check out the validity of your assumption. 


Write a small program that imports your newly created module, defines a small list called “cast，” 
and then uses the function provided by your module to display the contents of the list on screen. 
Use the following list data (all strings): Palin, Cleese, Idle, Jones, Gilliam, and Chapman. 



Open your program in IDLE’s edit window, and then press F5 to execute your code. Describe 
what happens in the space below: 
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idle error 



You were to write a small program that imports your newly created module, defines a small list 
called “cast,” and then uses the function provided by your module to display the contents of the 
list on screen. You were to use the following list data (all strings): Palin, Cleese, Idle, Jones, 
Gilliam, and Chapman. 



impovt r\es*tcv- 


dast — [’Palm’ ， ’Cleese’ ， ’Idle’, ’Jones’, ^illia^, ’Cha 卜 a/] 


Open your program in IDLE’s edit window, and then press F5 to execute your code. Describe 
what happens in the space below: 

But it didh 七 wov-k/ 一 -- ， IDLE —es ^ error, ay\d *the ^vog|\rair« docs r\o*t 


— ^ / An IDLE Session 



With your program in the IDLE edit window, pressing F5 (or choosing Run Module from the Run menu) does 
indeed cause problems: 


try_nester,py - /Users/barrvp/HeadFirstPython/chaptef2/try_nester,py 




import nester 




cast = [ r Palin 1 f ' Cleese 1 f f Idls r , ' Jones 1 , ' Gilliam' , 'Chapman 1 ] 

print 一 lol (cast) 




Ln: 6 

Col: 0 

A 


Your program does not appear to have executed and an error message is reported: 


»> 

»> 


RESTART 


Traceback (most recent call last) : 

File M /Users/barryp/HeadFirstPython/chapter2/try_nester.py M , line 4, in <module> 
print lol(cast) 
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sharing your code 


Pythow's modules implement namespaces 


All code in Python is associated with a namespace. 

Code in your main Python program (and within IDLE’s shell) is associated 

with a namespace called_main_. When you put your code into its own 

module, Python automatically creates a namespace with the same name as 
your module. So, the code in your module is associated with a namespace 
called nester. 


T^ s a double i h 

Jr the wov-d 〜 ih 
aHeir ii. 


dhd 



I guess namespaces are like family names? 

If someone is looking for Chris, we need to know 
if ifs Chris Murray or Chris Larkin, right? The 
family name helps to qualify what we mean, as do 
namespace names in Python. 


Yes, namespace names are like family names. 

When you want to refer to some function from a module 
namespace other than the one you are currently in, you need 
to qualify the invocation of the function with the module’s 
namespace name. 

So, instead of invoking the function as print_lol (cast) 
you need to qualify the name as nester .print_lol (cast) 
That way, the Python interpreter knows where to look. The 
format for namespace qualification is: the module’s name, followed 
by a period, and then the function name. 


module 



Thc Qticm is thch invoked as 
hoirmal wiih pv-ovided as 

"the lisx to pvodcss. 


/\ —od senates module 

外 awe. 
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ready for pypi 


r \ / An IDLE Session 


Let’s test this. Staying at the IDLE shell, import your module, create the list, and then try to invoke the function 
without a qualifying name. You’re expecting to see an error message: 

»> import nester 

»> cast = ['Palin', 'Cleese', 'Idle', 'Jones', 'Gilliam ', 'Chapman'] 

»> print 一 lol (cast) 

Traceback (most recent call last) : , % ^ z 

ts vouv- Code V^as caused a 



File "<pyshell#4 > M , line 1 , in <module> 
print lol(cast) 

ameError : name 'print lol' is not defined 



七 he y\3wc- 


When you qualify the name of the function with the namespace, things improve dramatically: 

»> nester .print_lol (cast) 

Palin 
Cleese 






Gee| B 如 


When you use a plain import statement, such as import nester, 
the Python interpreter is instructed to allow you to access nester’s 
functions using namespace qualification. However, it is possible to be 
more specific. If you use from nester import print_lol, the 
specified function (print—lol in this case) is added to the current 
namespace, effectively removing the requirement for you to use 
namespace qualification. But you need to be careful. If you already have 
a function called print—lol defined in your current namespace, the 
specific import statement overwrites your function with the imported 
one, which might not be the behavior you want. 


Your module is now ready for upload to PyPL 
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sharing your code 


Register with the PyPl website 

In order to upload your distribution to PyPI, you need to register with the 
PyPI website. This is a relatively straightforward process. 


Begin by surfing over to the PyPI website at http://pypi.python.org/ and 
requesting a PyPIID: 


Provide the Usc^a^e 
you'd like io use. 


Uicr 70UV Aos ⑼ ?assY/o^rd 
-fov 


七 Y/itc 

puv^oscs. 


ov\C), 


4ir 9 ct io 仙吐 the 
• ^ cc，) ^eMoy, bcW 
^li^kihj oh -the Rcjistc 
bu-fc-fcoh. 


Vr 


Manual user registration 





Password: 
Confirm: 


Email 

Address: 




Provide a valid era'll addvess. 



PGP Key ID 
(optional): 
Usage 
Agreement: 


(This identifies a PGP or GPG key) 


By registering to upload content to PyPI, I agree and affirmatively acknowledge the following: 


1. Content is restricted to Python packages and related information only. 

2. Any content uploaded to PyPI is provided on a non-confidential basis, 

3. The PSF is free to use or disseminate any content that I upbad on an unrestricted be 
the web site are granted an irrevocable^ worldwide f royalty-fr&e, nonexclusive license 
the content, including in ； digital form. 

4.1 represent and warrant that I have complied with ail government regulations cx>ncem 
particular, if I am subject to United States law, I represent and warrant that I have obt 
content I upload. I further affirm that any content I provide is not intended for use by r t 
States Export Administration Regulations. 



兒丨 agree 


Register 


If all of your registration details are in order, a confirmation message is sent 
to the email address submitted on the registration form. The email message 
contains a link you can click to confirm your PyPI registration: 


richard@python.org to me 

To complete your registration of the user 11 hfpython" with the python module 
index, please visit the following URL 

htto://pvDi. Dvthon .oro^ovDi ?:action~u ser&otk-EII KdwBxTY Slvfv GkHu lAizUbz 

si™v details I 

la^xVH 

_ 1 



You are now registered with PyPI- 


Youv PyPI \T ― 如 W. 
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register and upload 


Upload your code to PyPI 


You’re ready to rock! The code in your function has been placed in a module, 
used to create a distribution and installed into your local copy of Python. To 
upload your distribution to PyPI, complete these two steps: command-line 
registration with PyPI and command-line uploading. 


It might seem strange to have to register with PyPI again, seeing as you just 
did this with their website. However, the command-line uploading tool needs 
to be made aware of your PyPI Username and Password, and that’s what this 
registration does. Don’t worry: you have to do this only once. 


Ihstvu^-t setup -to ， 

Mgistcv you^* dc-bils. 


File Edit Window Help Register 


Co^-fivrw 七 ha 七 you 
-to use youv- 

jusi-d\rcaicd PyPI 


Use youv- PyPI 


sc*t*tu^^ s save 
-Pov -futuve 


$ python3 setup.py register 
running register 
running check 

We need to know who you are , so please choose either : 

1. use your existing login r 

2. register as a new user, 

3. have the server generate a new password for you (and email it to you ), or 

4. quit 

Your selection [default 1] : 

1 

Username : hfpython 
Password: 

Registering nester to http://pypi.python.org/pypi 
Server response (200) : OK 

I can store your PyPI login so future submissions will be faster. 

(the login will be stored in /Users/barryp/.pypirc) 

Save your login (y/N)?y 






With your registration details entered and saved, you are now ready to upload 
your distribution to PyPI. Another command line does the trick: r 、 一 


a module ^llcd 




Setup £.o^-Pi\rrwS 
"that 七 he upload^—^ 
is sudtcss-ful. 
dis*bribu 七 ion is rtow 
pa\rt o( PyPI. 


File Edit Window Help Upload 


$ python3 setup.py sdist upload 
running sdist 
running check 

reading manifest file 'MANIFEST^ 
creating nester-1.0.0 
making hard links in nester-1.0.0... 
hard linking nester.py -> nester-1.0.0 
hard linking setup.py -> nester-1.0.0 
Creating tar archive 

removing 'nester-1.0.0^ (and everything under it) 
running upload 

Submitting dist/nester-1.0.0.tar.gz to http://pypi.python.org/pypi 
Server response (200) : OK 


1 
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sharing your code 


Welcome to the PyPI community 

Congratulations! You are now a full-fledged, card-carrying member of the 
PyPI community. Your distribution has joined the over 10,000 other uploads 
on PyPI. Feel free to surf on over to the PyPI website to confirm the upload. 

Programmers from all over the globe are now able to download, unpack, and 
install your module into their local copy of Python, which is pretty cool when 
you think about it. 


Sit back, put your feet up, and wait for the plaudits to 
begin... 


Which is best: plain imports or 
specific imports? 

Neither, really. Most programmers 
mix and match based on their own personal 
preference and taste (although there are 
plenty of programmers willing to argue that 
their preferred way is the “one true way”). 

Note that the from module import 
function form pollutes your current 
namespace: names already defined in your 
current namespace are overwritten by the 
imported names. 

And when I press F5 in IDLE’s edit 
window, it’s as if the module’s code is 
imported with an import statement, right? 

Yes, that is essentially what happens. 
The code in your edit window is compiled 
and executed by Python, and any names 
in the edit window are imported into the 
namespace being used by IDLE’s shell. This 
is handy, because it makes it easy to test 
functionality with IDLE. But bear in mind that 
outside of IDLE, you still need to import your 
module before you can use its functionality. 



Is it really necessary for me to 
install my modules into my local copy of 
Python? Can’t I just put them in any old 
folder and import them from there? 

Yes, it is possible. Just bear in mind 
that Python looks for modules in a very 
specific list of places (recall the import 
sys ; sys . path trick from earlier 
in this chapter). If you put your modules 
in a folder not listed in Python’s path list, 
chances are the interpreter won’t find 
them, resulting in ImportErrors. Using the 
distribution utilities to build and install your 
module into your local copy of Python avoids 
these types of errors. 

Q/ ■ noticed the distribution utiliites 
created a file called nester • pyc. 
What’s up with that? 

That’s a very good question. When 
the interpreter executes your module code 
for the first time, it reads in the code and 
translates it into an internal bytecode format 
which is ultimately executed. (This idea is 
very similar to the way the Java JVM works: 
your Java code is turned into a class file as 


You vc 

puWishcdl y ovaV " 6 。如 ... 
V\o>/ tool 七七？ 


a result of your Java technologies compiling 
your code.) The Python interpreter is smart 
enough to skip the translation phase the next 
time your module is used, because it can 
determine when you’ve made changes to 
the original module code file. If your module 
code hasn’t changed, no translation occurs 
and the “compiled” code is executed. If your 
code has changed, the translation occurs 
(creating a new pyc file) as needed. The 
upshot of all this is that when Python sees a 
pyc file, it tries to use it because doing so 
makes everything go much faster. 

Cool. So I can just provide my 
users with the pyc file? 

No, don’t do that, because the use of 
the pyc file (if found) is primarily a runtime 
optimization performed by the interpreter. 

So, can I delete the pyc file if I don’t 
need it? 

Sure, if you really want to. Just be 
aware that you lose any potential runtime 
optimization. 
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conflicting requests 


With success comes responsibility 


Lots of programmers from many different locations are using your module. 
And some of these programmers are looking for more features. 



Hang on a second. 

I kinda like the way it 
works right now. I vote 
NOT to change it. 


^^ ah 9 cs "to the way you 
+Uh<l-tioh woirks likely ■(» 
ahhoy -this guy. 


Requests for change arc inevitable 

You need to keep your current users happy by maintaining the existing 
functionality, while at the same time providing enhanced functionality to 
those users that require it. This could be tricky. 


What are your options here? 
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sharing your code 


Life's full of choices 

When it comes to deciding what to do here, there’s 
no shortage of suggestions. 


Thafs soooo easy. Simply create 
another function called M print_lol2 ,, / 
right? You could then import the 
function you want using the specific 
form of the import statement. Ifs not 
that hard, really... 


Yeah，that might just work. 

You could edit your module’s code and define a new function called 
print—lol2, then code up the function to perform the nested printing 
When you want to use the original function, use this specific form of the 
import statement: from nester import print_lol. When you want 
to use the new, improved version of the function, use this import statement: 
from nester import print—lol2. 

Which would work, but... 


O 




Right. A second function is wasteful. 

Not only are you introducing an almost identical function to your 
module, which might create a potential maintenance nightmare, but 
you’re also making things much more difficult for the users of your 
module, who must decide ahead of time which version of the function 
they need. Adding a second function makes your module’s application 
programming interface (API) more complex than it needs to be. 

There has to be a better strategy, doesn’t there? 
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add an argument 


Control behavior with aw extra argument 

If you add an extra argment to your function, you can handle indentation 
within your current code without too much trouble. 



yikes! I shouldve thought about that 
myself... I probably need to go easy on 
the coffee. Of course, ifs clear to me 
now: adding another argument to your 
function gives you options. 


Take your function to the next level 

At the moment, your function has a single argument: the_list. If you add 
a second argument called level, you can use it to control indentation. A 
positive value for level indicates the number of tab-stops to include when 
displaying a line of data on screen. If level is 0, no indentation is used; if 
it’s 1， use a single tab-stop; if it’s 2, use two tab-stops; and so on. 

It’s clear you are looking at some sort of looping mechanism here, right? You 
already know how to iterate over a variably sized list, but how do you iterate a 
fixed number of times in Python? 


Does Python provide any functionality that can help? 
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sharing your code 


Pcforc your write new code, thiwk P1F 


When you come across a need that you think is generic, ask yourself if there’s 
a built-in function (BIF) that can help. After all, iterating a fixed number of 
times is something you’ll need to do all the time. 


And remember: Python 3 includes over 70 BIFs, so there’s a lot of 
functionality waiting to be discovered. 












Use your pencil to draw a line matching each BIF to the correct description. 
The first one is done for you. Once you have all your lines drawn, circle the 
BIF you think you need to use in the next version of your function. 

BiF WlictttKe BiF does 



Creates a numbered list of paired-data, starting 
from 0. 

Returns the unique identification for a Python 
data object. 

A factory function that creates a new, empty list. 


int () 


Returns the next item from a iterable data 
structure such as a list. 


id () Returns an iterator that generates numbers in a 

specified range on demand and as needed. 

next () Converts a string or another number to an 

integer (if possible). 
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who did what 










stiVNywo 从 


BiF 


list () 


You were to use your pencil to draw a line matching each BIF to the correct 
description. Once you had all your lines drawn, you were to circle the BIF 
you think you need to use in the next version of your function. 

WjictttKe BiF does 


Creates a numbered list of paired-data, starting 
from 0. 


TW»s W 

looks 

enumerate () 



、 Returns the unique identification for a Python 
x data object. 


A factory function that creates a new, empty list. 


Returns the next item from a iterable data 
^ structure such as a list. 


next() 


Returns an iterator that generates numbers in a 
specified range on demand and as needed. 


Converts a string or another number to an 
integer (if possible). 


The rawgeO PIF iterates a fixed number of times 

The range () BIF gives you the control you need to iterate a specific 
number of times and can be used to generate a list of numbers from zero up 
to-but-not-including some number. Here’s how to use it: 


is 七 

assi^cd cac\\ ^ 

fey ⑸呼 u 

•m 


for num in range(4): 
print(num) 



hum be vs up--fco- 

bu " t - hot - ihdudih3 午. 





TV^c 0, I , 2 •，孙 W.II 

ov> sdrea. 
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sharing your code 



9ns 


Don’t I need to import the BIFs in 
order to use them in my program? 

No. For all intents and purposes, the 
BIFs are specifically imported into every 
Python program as well as IDLE. 

So the BIFs must belong to the 
—main — namespace, right? 

No. They are automatically imported 
into the _ main __ namespace, but the 
BIFs have their very own namespace called 
(wait for it) builtins . 


I get how range() works, but surely 
I could just as easily use a while loop to 
do the same thing? 

Yes, you can, but it’s not as elegant 
as using range () _ Seriously, though, 
the while equivalent not only requires 
you to write more code, but it also makes it 
your responsibility to worry about loop state, 
whereas range () worries about this for 
you. As a general rule, Python programmers 
look for ways to reduce the amount of code 
they need to write and worry about, which 
leads to better code robustness, fewer errors, 
and a good night’s sleep. 


So BIFs are actually good for me? 


BIFs exist to make your programming 
experience as straightforward as possible 
by providing a collection of functions that 
provide common solutions to common 
problems. Since they are included with 
Python, you are pretty much assured that 
they have been tested to destruction and 
do “exactly what it says on the tin.” You can 
depend on the BIFs. Using them gives your 
program a leg up and makes you look good. 
So, yes, the BIFs are good for you! 



Now that you know a bit about the range () BIF, amend your function to use range () to 
indent any nested lists a specific number of tab-stops. 

Hint: To display a TAB character on screen using the print () BIF yet avoid taking a new-line 
(which is print ()'s default behavior), use this Python code: print ( n \t n , end=''). 


"This is the "nester.py" module and it provides one function called print 一 lol() 
which prints lists that may or may not include nested lists .’""， 


def print—lol(the_list 


Mude the Jthe e 如扣 3 _ 七 . 


"This function takes a positional argument called "the—list，，，which 

is any Python list (of - possibly - nested lists). Each data item in the 
provided list is (recursively) printed to the screen on it's own line."" 


for each—item in the_list : 

if isinstance(each—item, list) : 

print—lol(each—item) 
else : 


print(each—item) 


t -Povgc-t -to edit 

"the 匕 ommwt. 


MdUodc ^ 

tab - 和 s. 
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using range 


9!^ 


BceRcvSe 

SotiiivOH 


Now that you know a bit about the range () BIF, you were to amend your function to use 
range () to indent any nested lists a specific number of tab-stops. 

Hint: To display a TAB character on screen using the print () BIF yet avoid taking a new-line 
(which is print ()'s default behavior), use this Python code: print ( n \t n , end=''). 


’’"’This is the "nester.py" module and it provides one function called print—lol() 
which prints lists that may or may not include nested lists" 

def print—lol (the—list, level ) : 

"""This function takes a positional argument called n the—list，，，which 

is any Python list (of - possibly - nested lists). Each data item in the 
provided list is (recursively) printed to the screen on it's own line/ 

A sedohd av-^umch*t ddlled u level w is used 七。 msev 七 *tab-s*toj>s whch a hcs*tcd lis*t is ehdourrtered .” 卯 

for each—item in the—list: 

if isinstance (each item, list) : * . i i 

print lol (each — ltem) 心如 value orwr *to 6 。士 ol 

pnnt—loi (each_ lt em) / 一 一 7 妯 - 和 s a 代说 d. 

else : 

-for *m ra^gcOcvcl )： 

level 

print (each item) o\ ihcfch-ta-tioh. 


IDLE Session 


It’s time to test the new version of your function. Load your module file into IDLE, press F5 to import the function 
into IDLE’s namespace, and then invoke the function on your movies list with a second argument: 

y° uv " bcihg su\rc to provide 

»> print 一 lol (movies , 0) ^ 3 sedohd 

The Holy Grail 

1975 ^TKc Aaia *m w mov*ics w slaris -to affair oy> st 代 ⑶… 

Terry Jones & Terry Gilliam 
91 

Traceback (most recent call last) : ^ " 一 … 七 all hell bveaks loose/ is hot Hght 

File M <pyshell#2 >", line 1 , in <module> 
print—lol(movies,0) 

File M /Users/barryp/HeadFirstPython/chapter2/nester/nester.py ", line 14, in print 一 lol 
-acint lol(each_item) , } 

一 ncv-c s you\r dlue as {o 

print lol() takes exactly 2 positional arguments (1 given) - , »)' 

一 ^_i - — - 一 whats 



/ 
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vr todt Kds d 丁 Yfe&r\ro\r ， y/hidh 

caused 'rt *to dvash. 


















sharing your code 


Pythow tries its best to ruw your code 

Unlike compiled languages (such as C, Java, C#, and others), Python doesn’t 
completely check the validity of your code until it runs. This allows Python to do 
some rather cool things that just aren’t possible in those other languages, such 
as dynamically defining functions at runtime. This, of course, can be very 
flexible and powerful. 

The cost to you, however, is that you need to be very careful when writing 
your code, because something that typically would be caught and flagged as 
an “error” by a traditional, statically typed, compiled language often goes 
unnoticed in Python. 


0 


0 


… OK, C++ syntax fine...continuing to 
parse...whoops! You re trying to use a 
function before ifs declared?!? Thafs NOT 
allowed around here... I’m outta here. 


Please wait. 
Compiling 
your C++ 
code... 


Im 



Ah ha! The old ''calling 
a function before you’ve defined 
it yet" trick, eh? Til just make a note 
in case you define it later at runtime. 
You are planning to do that, right? 
Please don’t disappoint me, or* ril give 
you an error... 


O 


o 





Take another look at the error on the opposite 
page. Why do you think Python is giving you this 
particular error? What do you think is wrong? 


Running yourj 
Python code 
right now... 



i i 




m 
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line check 


Trace your code 

When you’re trying to work out what went wrong with a program that looks 
like it should be OK, a useful technique is to trace what happens as each line 
of code executes. Here’s the code that you are currently working with. At 
only three lines long (remember: the creation of the list is one line of code), it 
doesn’t look like it should cause any trouble: 


import nester 


movies 


Thes two lihes look 0 i(. 

/ 

The Holy Grail’ 1 , 1975, n Terry Jones & Terry Gilliam" f 
91,["Graham Chapman n , ["Michael Palin' 

n John Cleese 11 , "Terry Gilliam" r n Eric Idle 11 , 

▼▼Terry Jones n ]]] 

so -beat's 0 ^, W 


nester .print lol (movies, 0) 


With the data assigned to the function’s arguments, the function’s code starts The “movies” * |S . - ,, 

to execute on each data item contained within the passed-in list: _ _ “ 七 [>€ list' 3hd "the value O ' 

^sighed -to u |cvc| w . ^ 

"fo SdVC 七 ViC 



y\o{, sV\0Y/y\. 

Pv-otcss m 

*tV)C list- 

•••thch decide what - 
"to do hext based ov\ 
whethev ov- hot the 
data item is a list 


def print 一 lol(the 一 list, level) : 
▼▼▼▼▼▼This function 


參 •攀 



for each 一 item in the 一 list: 

〜今 if is instance (each_item^ list) : 

print 一 lol (each 一 item) ^ - 

else : 

for tab—stop in range(level) 
print( n \t n , end= 11 ) 
print(each item) 


(-P the daia item is a 
list, \rcdu\rsivcly invoke 

〆 the 匕 tioh … ha% oh 

a ^ov\d, that doesh^t 

look bright/? 
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sharing your code 


Work out whafs wrowg 

There’s your problem: the recursive invocation of your function is using the 
old function signature that required only one argument. The new version of 
your function requires two arguments. 


The fix is easy: provide the correct number of arguments when calling the 
new version of your function. So, this snippet of code from your function: 




Not so fast. Surely the nested 
list needs to be printed after a specific 
number of tab-stops? At the moment, your 
code sets ''level" to 0 but never changes the 
value, so ' 、 levd 〃 never has any impact on your 
displayed output... 


Right. Your use of “level” needs one final tweak. 

The whole point of having level as an argument is to allow you to 
control the nested output. Each time you process a nested list, you need 
to increase the value of level by 1. Your code snippet needs to look 
like this: 


if isinstance(each 一 item, list) : 
print 一 lol(each 一 item, level+1) 

--卢 


■t’s time to perform that update. 


a —7 level I 

you vc^sWcl 7 mvokc you^r 
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fresh pypi 


Update PyPl with your new code 

Go ahead and edit your nester . py module (in the nester folder) to 
invoke your function properly. Now that you have a new version of your 
module, it’s a good idea to update the distribution that you uploaded to PyPI. 

With your code amended, there’s also a small change needed to your 
distribution’s setup . py program. You’ve changed your API, so adjust the 
value associated with version in setup . py. Let’s move from version 1.0.0 
to 1.1.0: 


from distutils•core import setup 

Cjr) ^c ihc v^luc 

1.1.0 , 」 


setup( 


name 


version = 
py— modules = 
author = 
author 一 email = 
url = 
description = 


v C\rsioh. 


['nester'], 

'hfpython', 

'hfpythonQheadfirstlabs.com ’， 

'http :/ /www.headfirstlabs.com ， ， 

'A simple printer of nested lists'. 


Just as you did when you created and uploaded your distribution, invoke the 
setup . py program within your distribution folder to perform the upload: 


Pcm ’ 七 Y ou j uS ^ 

love *b^osc 

KK roo 0 ^ 

messages? 




少 


File Edit Window Help UploadAgain 


$ python3 setup.py sdist upload 
running sdist 
running check 

reading manifest file 'MANIFEST' 
creating nester-1.1.0 
making hard links in nester-1.1.0... 
hard linking nester.py -> nester-1.1.0 
hard linking setup.py -> nester-1.1.0 
Creating tar archive 

removing 1 nester-1.1.0' (and everything under it) 
running upload 

Submitting dist/nester-1.1.0.tar.gz to http : //pypi.python.org/pypi 
Server response (200) : OK 


] 


Your new distribution is now available on PyPI- 
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sharing your code 



Mark: Take a look at this, guys...the nester module has been 
updated on PyPI. 

Bob: Version 1.1.0". 

Laura: I wonder what’s changed? 

Mark: It still works with nested lists of lists, but now you can see the 
nested structure on screen, which I think is pretty cool. 

Laura: And useful. I’ve been waiting for that feature. 

Bob: Eh.. .OK.. .but how do I upgrade my existing local copy? 

Mark: Just follow the same steps as when you downloaded and 
installed nes ter from PyPI the first time. 

Bob: So I download the package file, unpack it, and ask setup . py to 
install it into my Python for me? 

Mark: Yes. It couldn’t be any easier. 

Laura: And what about my existing version of nes ter; what 
happens to that “old” version? 

Bob: Yeah...do I have two nes ter modules now? 

Mark: No. When you use setup . py to install the latest version 
it becomes the current version and effectively replaces the previous 
module, which was the 1.0.0 release. 

Bob: And PyPI knows to give you the latest version of the module, too, 
right? 


Mark: Yes, when you surf the PyPI website and search for nes ter, 
you are always provided with the latest version of the module. 

Laura: Well, I use this module all the time and I’ve been waiting for 
this feature. I think I’ll update right away. 

Mark: I’ve already upgraded mine, and it works a treat. 

Bob: Yeah, I use it a lot, too, so I guess I’ll keep my system up to date 
and install the latest version. It’s probably not a good idea to rely on 
out-of-date software, right? 

Mark: I’d say. And, there’s nothing quite like progress. 

Laura: Catch you later, guys, I’ve got work to do. 


Bob: Me, too. I’m off to PyPI to grab the latest nes ter and install 
it into my local copy of Python. I’ll give it a quick test to confirm all is 


OK. 


Mark: Later, dudes... 
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unhappy user 


You've changed your API 

Your new version of nester is indeed better, but not for all your users. 


Ah, phooey! I can’t believe it... I installed 
the latest version of u nester /, from PyPI, and 
now all of my code that uses your function is 
not working. What did you do?!? 



In your rush to release the lates and greatest version of your module, you 
forgot about some of your existing users. Recall that not all of your users want 
the new nested printing feature. However, by adding the second argument 
to print_lol (), you’ve changed your function’s signature, which means 
your module has a different API. Anyone using the old API is going to have 
problems. 

The ideal solution would be to provide both APIs, one which switches on the 
new feature and another that doesn’t. Maybe the feature could be optional? 



But how would that work? 
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sharing your code 


Use optional arguments 


To turn a required argument to a function into an optional argument, provide 
the argument with a default value. When no argument value is provided, the 
default value is used. When an argument value is provided, it is used instead 
of the default. The key point is, of course, that the default value for the 
argument effectively makes the argument optional. 

To provide a default value for any function argument, specify the default 
value after the argument name: 




3 。 仏 ^^ur^Ch-ts 


def print lol(the list, level) : 


def print lol(the list, level=0) : 



With the default value for the argument defined, you can now invoke the 
function in a number of different ways: 


TV\c addvb 。 灼 d a 

dc-faul-b value 

w levcl” 办 

OPTIONAL 


Invoke Br\d 

provide 


the ^uh^ioh with 

both avgumch-ts, but 
Provide 

stairtihg value for the 

se 匕 ohd dirgumcht. 


nester.print lol(movies , 0) 


nester.print lol(movies) 



/^Vokc the -fuh^ioh with 
° hC av\d use 

七 he ddaul 七 Vciluc -Pov* 

"the sc^ohd- 


Your function now supports different signatures, but the 
functonality remains as it was. 
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idle session 


「 \ 聲 ,、/' An IDLE Session 



Amend your code to give the level argument a default value of 0 and then load your code into the IDLE editor. 
Press F5 to load the code into the shell and then follow along to confirm that the latest version of your function 
works as expected. Start be defining a short list of lists and use the function to display the the list on screen: 


»> names = ['John ', ' Eric ', ['Cleese ', 'Idle '], 'Michael ', ['Palin']] 

»> print lol (names , 0) 


John 

Eric 


Cleese 

Idle 


Michael 


Palin 



丁 he s-f^hdavd bchaviov- wovks 

with hcs-tcd 
ihdcivtcd. 


Now try to do the same thing without specifiying the second argument. Let’s rely on the default value kicking in: 


»> print 一 lol (names) 
John 
Eric 


Michael 



dc-fault is used >wovks, too. 


Now specify a value for the second argument and note the change in the function’s behavior: 
»> print 一 lol (names, 2) 

John 
Eric 


Michael 



tttr 


One final example provides what looks like a silly value for the second argument. Look what happens: 
»> print lol (names , -9) 


John 

Eric 

Cleese 

Idle 

Michael 

Palin 



|\kc or\^a\ output ^or 


vcvs\oy\ I 0 0, 
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sharing your code 


Your module supports both APIs 

Well done! It looks like your module is working well, as both APIs, the original 
1.0.0 API and the newer 1.1.0 API, can now be used. 


Let’s take a moment to create and upload a new distibution for PyPI. As 
before, let’s amend the version setting in the setup . py program: 



And with the code changes applied, upload this new version of your 
distribution to PyPI: 


File Edit Window Help UploadThree 


TWis all looks 



$ python3 setup.py sdist upload 
running sdist 
running check 

reading manifest file 'MANIFEST' 
creating nester-1.2.0 
making hard links in nester-1.2.0... 
hard linking nester.py -> nester-1.2.0 
hard linking setup.py -> nester-1.2.0 
Creating tar archive 

removing 1 nester-1.2.0' (and everything under it) 
running upload 

Submitting dist/nester-1.2.0.tar.gz to http://pypi.python.org/pypi 
Server response (200) : OK 






Success! The messages from setup . py confirm that the your latest version 
of nester is up on PyPI. Let’s hope this one satisfies all of your users. 






Consider your code carefully. How might some of 
your users still have a problem with this version of 
your code? 
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faulty default 


Your API is still wot right 

Although the API lets your users invoke the function in its original form, the 
nesting is switched on by default. This behavior is not required by everyone and 



Of course, if you have some functionality that really ought to be optional 
(that is, not the default), you should adjust your code to make it so. But how? 


One solution is to add a third argument which is set to True when the 
indenting is required and False otherwise. If you ensure that this argument 
is False by default, the original functonality becomes the default behavior 
and users of your code have to request the new indenting feature explicitly. 


Let’s look at adding this final revision. 
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sharing your code 


o 

E^ftc 故 


Amend your module one last time to add a third argument to your function. Call your argument 
indent and set it initially to the value False— that is, do not switch on indentation by default. 
In the body of your function, use the value of indent to control your indentation code. 


Note: to save a bit of space, the comments from the module are not shown here. Of course, you 
need to make the necessary adjustments to your comments to keep them in sync with your code. 


def print lol (the list. 


Pu*t "the cx-tv-5 dirgumcht 

hcv-c. 

〆 

,level=0) : 


for each—item in the—list: 

if isinstance(each—item, list) : 

print_lol(each—item, 
else : 


V^a*t meeds 
- m 


, level+1) 


^ddi a Vmc todc 

^0 tor\{yo\ 



for tab_stop in range(level) : 
print ( "\t ", end=’ ▼) 


print(each—item) 


❺ 


With your new code additions in place, provide the edit you would recommend making to the 
setup, py program prior to uploading this latest version of your module to PyPI: 



Provide the command you would use to upload your new distribution to PyPI: 
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adding an argument 



o You were to amend your module one last time to add a third argument to your function. You were 
to call your argument indent and set it initially to the value False— that is, do not switch on 
indentation by default. In the body of your function, you were to use the value of indent to 
control your indentation code. 


Did you ih^ludc "the 
dc-fduli value? 

/ 

def print_lol(the_list, , level=0) : 

for each—item in the—list: so DC sur 

if isinstance (each—item, list) : 

print—lol (each—item, mdch*t , level+1) 

else : 

^ md 伙七 ： < ^ ov *9^ ^ ^oloh ai ihc Chd of the M -,r Ii hc . 

for tab_stop in range(level) : 

\\\t print r\t", end=' ' ) 

print(each—item) 

~ A sweet alternative io this loop 

，s th,s CoAt： * level 


A With your new code additions in place, you were to provide the edit you would recommend 
w making to the setup, py program prior to uploading this latest version of your module to PyPI: 

Edi 七 “setup.py” so i 七 reads ： version ==■ { I3.0\ 

Tl i 卜， ve«io M o( youv module, so be suve 乜 An 

^ ▲— 办 w 、 ， vt Pp /Jil e . 

❺ You were to provide the command you would use to upload your new distribution to PyPI: 

sc-tup.py sdisk upload 

mstcad . 
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sharing your code 


r ^ / An IDLE Session 


A final test of the functionality should convince you that your module is now working exactly the way you and your 
users want it to. Let's start with the original, default behavior: 

>>> names = ['John ', 'Eric', ['Cleese', 'Idle '], 'Michael', ['Palin']] 

>>> print 一 lol(names) 

John 
Eric 
Cleese 


Idle 

Michael 

Palin 



The oHjihal, dc4ult -fuh^iohali-ty 
Bob? Ucd (ih3i should plcasc 


Next, turn on indentation by providing True as the second argument: 

>>> names = ['John', 'Eric ', ['Cleese', 'Idle '], 'Michael', ['Palin']] 
>>> print lol(names , True) 


John 

Eric 


Michael 




a sttov\A 

s possible *to 0Y\ mdcv\tcd 

切 u*t (kccfmj Laura ha??'/). 


And, finally, control where indentation begins by providing a third argument value: 

Idle '] f ' Michael ', ['Palin']] 


>>> print lol(names , True , 4) 


['Cleese' 

,'Idle 

John 


Eric 



Cleese 


Idle > 

Michael 



Palin 


/hdchtihg -Pirom a spedi 匕 



this! 



Go ahead and edit your 
setup . py file; then upload 
your distribution to PyPI. 
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one module for all 


Your module's reputation is restored 

Congratulations! Word of your new and improved module is spreading fast. 



My programs are back to 
working the way I want 
them to, so I’m a happy 
guy. Thanks! 


* This is as ^losc as Bob gets 
■to, a smile. But ivus-t us ; 
he’s happy. © 


a 


Your Python skills are starting to build 

You’ve created a useful module, made it shareable, and uploaded it to the 
PyPI website. Programmers all over the world are downloading and using 
your code in their projects. 

Keep up the good work. 
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Your Pythow Toolbox 

You’ve got Chapter 2 under your 
belt and you’ve added some key 
Python goodies to your toolbox. 




BULLET POINTS 


Use a 如 仫 * mtludc 

卜 Ue *rn You^r dodc- 

Typr' Padkay W# ad 

•is v/ell 3 visit 

• is a ^ladc *m Py^o^s 

mcmovY names c%*»st 

@ py^o^s mam ^ames^ate *.s as 


a 


main 


S 


IDLE l^/oie 

.FV«S F5 h> Vu, w -th c £ od c i, th c IDLE 

edit wihdow. 

^ ^Vhch you p^css F5 io u load ；； a modules 
toAt ^ ihc ^ shell, the moduli 
^ ^ 啊 •• 仏 || y i 个士 d ••士 
, bs This is a — hieh “ 

whe, usi h g /DLE. _”财 喊 you 

wed to u 叱 ihe import siaic^i 

CXp|i^i*t|y. 


■ A module is a text file that contains Python 
code. 


■ 


■ 


■ 


■ 


■ 


■ 


■ 


■ 


■ 


The distribution utilities let you turn your 
module into a shareable package. 

The setup.py program provides 
metadata about your module and is used 
to build, install, and upload your packaged 
distribution. 

Import your module into other programs 
using the import statement. 

Each module in Python provides its own 
namespace, and the namespace name 
is used to qualify the module’s functions 
when invoking them using the module, 
function () form. 

Specifically import a function from a module 
into the current namespace using the from 
module import function form of 
the import statement. 

Use # to comment-out a line of code or 
to add a short, one-line comment to your 
program. 

The built-in functions (BIFs) have their own 
namespace called — builtins — , 
which is automatically included in every 
Python program. 

The range () BIF can be used with for to 
iterate a fixed number of times. 

Including end= A A as a argument to the 
print () BIF switches off its automatic 
inclusion of a new-line on output. 

Arguments to your functions are optional if 
you provide them with a default value. 


CHAPTER 2 
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3 ?!les and exceptions 




參 Dealing with errors ♦ 



I always thought he was 
exceptional...especially when it 
comes to processing my files. 




It’s simply not enough to process your list data in your code. 

You need to be able to get your data into your programs with ease, too. It’s no surprise 
then that Python makes reading data from files easy. Which is great, until you consider 
what can go wrong when interacting with data external to your programs...and there 
are lots of things waiting to trip you up! When bad stuff happens, you need a strategy for 
getting out of trouble, and one such strategy is to deal with any exceptional situations 
using Python’s exception handling mechanism showcased in this chapter. 


this is a new chapter 
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getting data in 


Pata is external to your program 

Most of your programs conform to the input-process-output model., data comes 
in, gets manipulated, and then is stored, displayed, printed, or transferred. 



So far, you’ve learned how to process data as well as display it on screen. 
But what’s involved in getting data into your programs? Specifically, what’s 
involved in reading data from a file? 


How does Python read data from a file? 
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files and exceptions 


If s all lines of text 

The basic input mechanism in Python is line based: when read into your 
program from a text file, data arrives one line at a time. 

Python’s open () BIF lives to interact with files. When combined with a for 
statement, reading files is straightforward. 


Youv- da*ta m a 七 c 乂七 
-f ile called w skc*Wv*U 七 . 





Vouv daia 
3s ihdividual 

lihcs. 


When you use the open () BIF to access your data in a file, an iterator is 
created to feed the lines of data from your file to your code one line at a time. 
But let’s not get ahead of ourselves. For now, consider the standard open- 
process-close code in Python: 




Da this! 


Create a folder called 
HeadFirstPython and a 
subfolder called chapter3. 
With the folders ready, 
download sketch . txt from 
the Head First Python support 
website and save it to the 
chapter 3 folder. 


Let’s use IDLE to get a feel for Python’s file-input mechanisms. 
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idle session 


r \jp / An IDLE Session 


Change -to -the (older ihal youv data -fil 


e. 


Start a new IDLE sesson and import the os module to change the current working directory to the folder that 
contains your just-downloaded data file: 

»> import os <_& Sta^d 

»> os . getewd () "\^ S "the duW"Cir>*t v/oV"kil^ diV"Cd*toV*y? 

'/Users/barryp/Documents' 

»> os . chdir (' . . /HeadFirstPython/chapter3 ' 

»> os.getewd() \ Coir\-fiv-m you a\rc y \ o^i \ y \ pladc. 

'/Users/barryp/HeadFirstPython/chapter3 ') 


Now, open your data file and read the first two lines from the file, displaying them on screen: 

»> data = open (' sketch. txt -) £ _ 0^y\ a -file a^d assign ihc -file b> a -file objedi called u dala w . 

»> print (data. readline () r end='') 

Man: Is this the right room for an argument? ) Use i\\t VadlrneO” method *to j'rab a ^ 


»> print (data. readline () , end='') 
Other Man : I've told you once. 



|* mC -fvom use 

BIP *to display it or\ Screen. 


Let's "rewind" the file back to the start, then use a for statement to process every line in the file: 

^ Use w scckO w method bo -to i\\t siairi o( (\\c 

J\y\A yes, you dav> use w -tcllO w pythons -f lics, "too. 


»> data. seek ( 0 ) 4 — 

0 

»> for each—line in data : 

print(each line, end='') 


d dc look a siay)d ^ d 


•Oh usi 


Man: Is this the right room for an argument? 
Other Man : I've told you once. 

Man: No you haven't! 

Other Man : Yes I have. 

Man: When? 

Other Man : Just now. 

Man: No you didn't! 

Man: (exasperated) Oh, this is futile!! 
(pause) 

Other Man : No it isn't! 

Man: Yes it is! 

»> data. close () 


h 9 -files daia as i h pui 


tvev-y I'mc c^f *tV)c is 
displayed ov\ (altho— 

-fov- \rcasor\S, *i*t is 

abvidyd V^cv-c). 


Sihdc you a\rc r>ow Aoi\t v/iih the -file, be sure io dose it 
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files and exceptions 


Take a closer look at the data 


Look closely at the data. It appears to conform to a specific format: 

A doloy>> -followed by d 

spate thav-adiev- 


TV east 
wcwkc/s v-olc 


Tlic lihe spoken by the 
^s-t meiTMbev" 


Man(Qls this the right room for an argument? 
Other Man : I r ve told you once. 

Man : No you haven't! 

Other Man : Yes I have. 

Man: When? 

Other Man : Just now. 

Man : No you didn A t! 



With this format in mind, you can process each line to extract parts of the line 
as required. The split () method can help here: 


Man : Is this the right room for an argument? 


^ Weak ^ 
⑽ a ” 《一. 



This tells w sp|iiO w 
what "to spirt 


Oh. 


Man 



| j 

Is this the right room for an argument? | 



The split () method returns a list of strings, which are assigned to a list of 
target identifiers. This is known as multiple assignment.. 


/\ \\si led 

卜 - 


•••cHrc 


ass， 9 hcd ^ by M S p|i-tO 


(role, line 一 spoken) = each 一 line • split 


V 


^ k 上 vc / Vo | c ” is f tW,s 

9 hcd 士 … 3 whe^as 七 ^ ^ 七 代。州 W a” aq_cA? 

Well? U © 
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idle session 


Iff / An IDLE Session 


Let’s confirm that you can still process your file while splitting each line. Type the following code into IDLE’s shell: 

»> data = open (' sketch. txt') - Opch the dsia -fi| c . 

»> for each line in data: 

(role , 1 ine_spoken) = each_line.split( ':') I process data, ^ 

print (role, end:' ') ^ I'mC 出 ― 外 ” ? 狄七。於 s£YCC 於 ’ 

print(' said: ', end='') 
print(line_spoken , end='') 

Man said: Is this the right room for an argument? 

Other Man said: I've told you once. 

Man said: No you haven't! 

Other Man said: Yes I have. 

Man said: When? 

Other Man said: Just now. 

Man said: No you didn't! 

Other Man said: Yes I did! 

Man said: You didn't! 

Other Man said: I'm telling you, 

Man said: You did not! 

Other Man said: Oh I'm sorry, is this a five minute argument, or the full half hour? 
Man said: Ah! (taking out his wallet and paying) Just the five minutes. 

Other Man said: Just the five minutes. Thank you. 

Other Man said: Anyway, I did. 

Man said: You most certainly did not! 

TV^c’s sowrtWm^ scvtously 

Y/\roy\^ 
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Ifs a ValueError, so 
that must mean theres 
something wrong with the 
data in your file, right? 








files and exceptions 


Know your data 

Your code worked fine for a while, then crashed with a runtime error. The 
problem occurred right after the line of data that had the Man saying, “You 
most certainly did not!” 


Let’s look at the data file and see what comes after this successfully processed 
line: 



Notice anything about the next line of data? 


The next line of data has two colons, not one. This is enough extra data 
to upset the split () method due to the fact that, as your code currently 
stands, split () expects to break the line into two parts, assigning each to 
role and line_spoken, respectively. 

When an extra colon appears in the data, the split () method breaks the 
line into three parts. Your code hasn’t told split () what to do with the third 
part, so the Python interpreter raises a ValueError, complains that you 
have “too many values,” and terminates. A runtime error has occurred. 



What approach might you take to solve this data- 
processing problem? 



this! 


To help diagnose this 
problem, let’s put your 
code into its own file called 
sketch . py. You can copy 
and paste your code from 
the IDLE shell into a new 
IDLE edit window. 
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ask for help 


Know your methods and ask for help 

It might be useful to see if the split () method includes any functionality 
that might help here. You can ask the IDLE shell to tell you more about the 
split () method by using the help () BIF. 


iT / An IDLE Session 


»> help (each line. split) 


split (...) 

S.split([sep [ r maxsplit]]) -> list of strings 



Looks like M splitO w "bkes 
op-tioh^l avgumcht 



delimiter string. If maxsplit is given , at most maxsplit 
splits are done. If sep is not specified or is None , any 
whitespace string is a separator and empty strings are 
removed from the result. 


The optional argument to split () controls how many breaks occur within 
your line of data. By default, the data is broken into as many parts as is 
possible. But you need only two parts: the name of the character and the line 
he spoke. 

If you set this optional argument to 1, your line of data is only ever broken 
into two pieces, effectively negating the effect of any extra colon on any line. 


Let’s try this and see what happens. 



Gee} BUS - 

IDLE gives you searchable access to the entire Python 
documentation set via its Help —► Python Docs menu option (which 
will open the docs in your web browser). If all you need to see is the 
documentation associated with a single method or function, use 
the help () BIF within IDLE's shell. 


擎 



多 

split(beans r 1) 
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files and exceptions 


/ An IDLE Session 


Here’s the code in the IDLE edit window. Note the extra argument to the split () method. 


^nn sketch.py - /Users / barryp/ HeadF t rstFVthon/chapter4/sketch.py 


data = open( r sketch-txt ' } 

for each_line in data: 

(role f line_spoken)= 
print (role,^end=' 1 ) 
print ( 1 saidt 1 , end= r 
print (line_spoken, end 

data,close() 


each line,split ) 1 





I 丁 ^^ cx-tva airgui^civt 
- ^Ohiv-ols how 、 plrfcO” 


Ln: 11 


Cot: 0 


1 ^ 


s 


plits. 


With the edit applied and saved, press F5 (or select Run Module from IDLE’s Run menu) to try out this version of 
your code: 


»> 

»> 


RESTART 


Man said: Is this the right room for an argument? 
Other Man said: I've told you once. 

Man said: No you haven't! 

Other Man said: Yes I have 
Man said: When? 

Other Man said: Just now. 



TV\c d'»sflaYcd 。々认七 
aWidyd *to allo>/ 

_ 。山赴 stuW M •，七撕 

七 Wis ㈣ e. 


Other Man said: Anyway, I did. 

Man said: You most certainly did not! 

Other Man said: Now let's get one thing quite clear: I most definitely told you! 
Man said: Oh no you didn't! 

Other Man said: Oh yes I did! 

Man said: Oh no you didn't! 

Other Man said: Oh yes I did! … Wt 

Man said: Oh look, this isn't an argument! 

Traceback (most recent call last) : 


Cool, you made it past the 
I … C wi 七 li 七 y/ 。 dolohS... 



… but 7 喊 W d 叫 jved. T 一、 

ANOTHER \/aluc&r …!！ 


File M /Users/barryp/HeadFirstPython/chapter4/sketch.py ", line 5 , in <module> 
(role, line_spoken) = each_line.split 1 , 1) 

ValueError : need more than 1 value to unpack 


That’s enough to ruin your day. What could be wrong now? 
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missing colon 


Know your data (better) 


Your code has raised another ValueError, but this time, instead of 
complaining that there are “too many values,’’ the Python interpreter is 
complaining that it doesn’t have enough data to work with: “need more than 
1 value to unpack.” Hopefully, another quick look at the data will clear up the 
mystery of the missing data. 


Other Man : Now let’s get one thing quite clear : I most definitely told you 
Man : Oh no you didn't! 

Other Man : Oh yes I did! 

Man : Oh no you didn't! 

Other Man : Oh yes I did! 

Man : Oh look, this isn't an argument! 

(pause) ^ - 

Other Man : Yes it is! 

Man : No it isn't! 

(pause) < - 

Man : It's just contradiction! 

Other Man: No it isn't! 





The case of the missing colon 


Some of the lines of data contain no colon, which causes a problem when 
the split () method goes looking for it. The lack of a colon prevents 
split () from doing its job, causes the runtime error, which then results in 
the complaint that the interpreter needs “more than 1 value.” 


It looks like you still have 
problems with the data in 
your file. What a shame ifs 
not in a standard format. 


0 
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Two very different approaches 



Or you could decide to let the 
errors occur, then simply handle 
each error if and when it happens. 
That would be exceptional. 


When you have to deal with a 
bunch of exceptional situations, the 
best approach is to add extra logic. 
If theres more stuff to worry 
about, you need more code. 


Jill’s suggested approach certainly works: add the extra logic required to work out 
whether it’s worth invoking split () on the line of data. All you need to do is 
work out how to check the line of data. 

Joe’s approach works, too: let the error occur, spot that it has happened, and then 
recover from the runtime error...somehow. 


Which approach works best here? 
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find the substring 


Add extra logic 


Let’s try each approach, then decide which works best here. 

In addition to the split () method, every Python string has the find () 
method, too. You can ask find () to try and locate a substring in another 
string, and if it can’t be found, the find () method returns the value -1. If 
the method locates the substring, find () returns the index position of the 
substring in the string. 


rf / An IDLE Session 


Assign a string to the each—line variable that does not contain a colon, and then use the find () method to 
try and locate a colon: 

»> each_line = "I tell you, there's no such thing as a flying circus. M 
»> each_line. find (':') 

-1 ^_ - The docs NOT a dolov>, so w ^*mdO w v-c*tu\nr>s -I -fov- NOT FOUNP- 

Press Alt-P twice to recall the line of code that assigns the string to the variable, but this time edit the string to 
include a colon, then use the find () method to try to locate the colon: 

»> each_line = "I tell there's no such thing as a flying circus." 

»> each_line. find (':') 

10 - - 



'DOBS •… a dolo^ so v-c*tu\r^s d positive mdex value- 



And you thought this approach wouldiVt 
work? Based on this IDLE session, I 
think this could do the trick. 


O 
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files and exceptions 


9 ^. 




Adjust your code to use the extra logic technique demonstrated on the previous page to deal 
with lines that don’t contain a colon character. 

data = open('sketch.txt') 

for each—line in data : 
if 

(role, line_spoken) = each—line•split, 1) 
print(role, end='*) 
print ( ' said: ', end=’ ▼) 

print(line_spoken, end='') 


V\A>a 七 *to 50 hcvc? 


data.close () 


(K^rpen your pencil 


Can you think of any potential problems with this technique? 
Grab your pencil and write down any issues you might have with 
this approach in the space provided below: 
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substring found 


ExeRciSe 

SoLutvo 


You were to adjust your code to use the extra logic technique to deal with lines that don’t contain 
a colon character: 


data = open('sketch.txt') 


for each—line in data : 

if r\o*t eddh 



p iskcs a -few sc^ohds -to get y ou ^ 

7 ad 扣 。⑹ d ihis ^ohditioh, but it 
docs wovk. 


Mote vasc ^ 
the value o^r 




I (role, line_spoken) = each—line•split( 1 
’ print(role, end= 1 ') 

print ( ' said : ', end= 1 ') 

print(line_spoken, end= 1 *) 


1) 


data.close () 


^ Sharpen your pencil 

Solution 


l^s 0^ 1°^ ! ss t cs 


You were to think of any potential problems with this technique 
grabbing your pencil to write down any issues you might have 
with this approach. 


{ = = = = = = = = = = 

There be d problem wi 七 h -this CoAt i-f 七 he -fo\rr«a*t o-f *thc dd*bd -file 

whidh will require {p *the dohdi*tioh. 


/ 


The dohdi*tioh used by -the i-f s*ta*tc^ch*t is somcwKa*t havd bo read 
uhdc\rs*tar\d. 


This Code is a little u -fvajilc w ...i*t will break i-f ar\o*thcv C^dCj>*tiohal 
si*tua*tior\ arises. 


86 Chapter 3 























files and exceptions 




Tqst DriVQ 


Amend your code within IDLE’s edit window, and press F5 to see if it works. 


只 0, ^ Python Shell 

»> ——---—— RESTART --—-- - 

>» 

Man said : Is this the right room for an argument? 

Other Man said: I f ve told you once* 

Man said : No you haven 1 1J 

Other Man said: Yes I have* 

Man saidi When? 

Other Man saidt Just now. 

Man said t Uo you didn'tJ 

Other Man said; Yes I didJ 

Man said : You didn't! 

Other Man said: I p m telling you, I didJ 

Man said t You did not J 

Other Man saidi Oh I p m sorry, is this a five minute argument, or the full half hour? 
Man said : Ah I (taking out his wallet and paying} Just the five minutes * 

Other Man saidt Just the five minutes * Thank you. 

Other Man saidi Anyway, I did, 

Man saidi You most certainly did not 1 

Other Man said: Now let p s get one thing quite clears I most definitely told you! 

Man saidi Oh no you didn F t! 

Other Man said; Oh yes I didJ 

Man saids Oh no you didn F tJ 

Other Man saidi Oh yes I didJ 

Man saidi Oh look, this isn't an argument I n. 

Other Man saidi Yes it is J 

Man said: No it isn p tJ 

Man saidi It 1 s just contradiction J \ 

Other Man said: No it isn ' t i K/^ ^ 

Man saidi It ISJ ^ - - - ^ ^ 

Other Man saidi It is NOT J this tir»c. 

Man said: You just contradicted me J 

Other Man said ： No I didn r tl 

Man saidi You DID! 

Other Man said: No no no! Cc 

Man said: You did just thenJ 

Other Man said: Nonsense! 

Man saidt (exasperated) Oh f this is futile!J 

Other Man saidi No it isn 1 1J 

Man saids Yes it is! 

»> 1 

r 

{ 

Jl 

'T 


Ln: 149 

Cof: 4 



Your program works...although it is fragile. 


If the format of the file changes, your code will 
need to change, too, and more code generally means 
more complexity. Adding extra logic to handle 
exceptional situations works, but it might cost you 
in the long run. 



0 


O 


Maybe it's time for a 
different approach? One 
that doesn*t require extra 
logic, eh? 
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exceptional catch 


Handle exceptions 


Have you noticed that when something goes wrong with your code, the 
Python interpreter displays a tmceback followed by an error message? 

The traceback is Python’s way of telling you that something unexpected has 
occurred during runtime. In the Python world, runtime errors are called 

exceptions. 




»> if not each 

Traceback (most r| 
File、'<pyshell 
(role, line_ 
ValueError : too 



0 


o 




Whoooah! I don't 
know what to do with this 
error, so I’m gonna raise 
an exception...this really is 
someone elses problem. 


Of course, if you decide to ignore an exception when it occurs, your program 
crashes and burns. 

But here’s the skinny: Python let’s you catch exceptions as they occur, which 
gives you with a chance to possibly recover from the error and, critically, not 
crash. 

By controlling the runtime behavior of your program, you can ensure (as 
much as possible) that your Python programs are robust in the face of most 
runtime errors. 

Try the code first. Then deal with errors as they happen. 
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Try first thcw recover 


Rather than adding extra code and logic to guard against bad things 
happening, Python’s exception handling mechanism lets the error occur, 
spots that it has happened, and then gives you an opportunity to recover. 

During the normal flow of control, Python tries your code and, if nothing goes 
wrong, your code continues as normal. During the exceptional flow of control, 
Python tries your code only to have something go wrong, your recovery code 
executes, and then your code continues as normal. 





The try/except mechanism 

Python includes the try statement, which exists to provide you with a way to 
systematically handle exceptions and errors at runtime. The general form of 
the try statement looks like this: 


Pythoh tvics 
yowr todt, but 



Youv 

\s \^dlcd. 


you keep 
30 —.. 


OY\ 



try: 


d^d Weft” 
av-c 

key … ov "d s 


your code (which might cause a runtime error) 


except : 
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allow errors 




No. Not mad. And ， yes. Letting errors occur. 

If you try to code for every possible error, you’ll be at it for a 
long time, because all that extra logic takes a while to work out. 

Paradoxically, when you worry less about covering every 
possible error condition, your coding task actually gets easier. 
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Identify the code to protect 

In order to plug into the Python exception handling mechanism, take a 
moment to identify the code that you need to protect. 


Study your program and circle the line or lines of code that you 
think you need to protect. Then, in the space provided, state why. 

data = open( ' sketch.txt') 
for each—line in data : 

(role, line_spoken) = each—line•split, 1) 
print(role, end= 1 ') 
print ( ' said: ▼, end= 1 ') 

print(line_spoken, end='') 

data.close() 

State 7 。 吖代 as 挪 


<K^arpen your pencil 


iJieretare no 

Dumb Qi] 


Questions 


Q/ Something has been bugging me for a while. When the split() method executes, it passes back a list, but the target identifiers 
are enclosed in regular brackets, not square brackets, so how is this a list? 

Well spotted. It turns out that there are two types of list in Python: those that can change (enclosed in square brackets) and those that 
cannot be changed once they have been created (enclosed in regular brackets). The latter is an immutable list, more commonly referred 
to as a tuple. Think of tuples as the same as a list, except for one thing: once created, the data they hold cannot be changed under any 
circumstances. Another way to think about tuples is to consider them to be a constant list. At Head First, we pronounce “tuple” to rhyme with 
“couple.” Others pronounce “tuple” to rhyme with “rupal.” There is no clear concensus as to which is correct, so pick one and stick to it. 
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code to protect 


^ Sharpen your pencil 

Solution 


You were to study your program and circle the line or lines of 
code that you think you need to protect. Then, in the space 
provided, you were to state why. 


data = open( ' sketch.txt') 



TV^sc W 

\\y\cs toAt 
a \\ 


l-ir *tKc td\\ ho u spli*tO^ -fails, you do^*t *thc -three w p\r*mt6 w 
s*ta*tcr«Ch*b so i*t’s bcs*t *bo p\ro*ted all -four I'mes -the w i*f" 

suite, hot jus*t *thc l*mc Code *tha*t ddlls » 七 0”. 
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OK. I get that the code 
can be protected from an 
error. But what do I do when 
an error actually occurs? 


Chapter 3 



Yeah...good point. It*s 
probably best to ignore 
it, right? I wonder how.. 















files and exceptions 


Take a pass on the error 

With this data (and this program), it is best if you ignore lines that don’t 
conform to the expected format. If the call to the split () method causes 
an exception, let’s simply pass on reporting it as an error. 

When you have a situation where you might be expected to provide code, but 
don’t need to, use Python’s pass statement (which you can think of as the 
empty or null statement.) 

Here’s the pass statement combined with try: 



Now, no matter what happens when the split () method is invoked, the 
try statement catches any and all exceptions and handles them by ignoring the 
error with pass. 

Let’s see this code in action. 



Make the required changes 
to your code in the IDLE 
edit window. 
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idle session 


94 



With your code in the IDLE edit window, press F5 to run it. 

sketch-try,py - /Users/banryp/HeadFirstPythorii/chapter4/sketdi~try.py 


data - open ( 1 sketch-txt ■ } 

for each line in datai 
try 

(role, line_spoken) = each 一 line.split(■ i ■ , 1) 
print (role,^end= f ' ) 
print ( 1 saidi r f end= ' 1 ) 
print (line_spoken f end= 1 ' ) 
except i 
pass 

data.close() 


Ln: 14 Col: 0| x； ； 


»> 

»> 


RESTART 


Man said : Is this the right room for an argument? 
Other Man said : I've told you once. 

Man said : No you haven't! 

Other Man said : Yes 工 have. 

Man said : When? 


' 


This todc wovb ; a h d theve 
ho … Aw cinrov-s, cithev. 


OOther Man said: Nonsense! 

Man said : (exasperated) Oh, this is futile!! 

Other Man said : No it isn't! 

Man said : Yes it is! 
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files and exceptions 


Fireside Ghats 


Tonight’s talk ： Approaching runtime errors with extra code 
and exception handlers 


Extra Code: 

By making sure runtime errors never happen, I keep 
my code safe from tracebacks. 


Complexity never hurt anyone. 


I just don’t get it. You’re more than happy for your 
code to explode in your face.. .then you decide it’s 
probably a good idea to put out the fire?!? 


But the bad things still happen to you. They never 
happen with me, because I don’t let them. 

Well...that depends. If you’re smart enough —— and, 
believe me, I am — you can think up all the possible 
runtime problems and code around them. 

Hard work never hurt anyone. 


Of course all my code is needed! How else can you 
code around all the runtime errors that are going to 
happen? 

Um, uh.. .most of them, I guess. 


Exception Handler: 


At the cost of added complexity.... 

I’ll be sure to remind you of that the next time 
you’re debugging a complex piece of code at 4 
o’clock in the morning. 


Yes. I concentrate on getting my work done first and 
foremost. If bad things happen, I’m ready for them. 


Until something else happens that you weren’t 
expecting. Then you’re toast. 


Sounds like a whole heap of extra work to me. 


You did hear me earlier about debugging at 4 AM, 
right? Sometimes I think you actually enjoy writing 
code that you don’t need … 


Yeah.. .how many? 

You don’t know, do you? You’ve no idea what will 
happen when an unknown or unexpected runtime 
error occurs, do you? 


Look: just cut it out. OK? 
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more errors 


What about other errors? 

It is true that both approaches work, but let’s consider what happens when 
other errors surface. 



Handling missing files 

Frank’s posed an interesting question and, sure 
enough, the problem caused by the removal of 
the data file makes life more complex for Jill and 
Joe. When the data file is missing, both versions of 
the program crash with an 工 OError. 



Da this! 



Rename the data file, then 
run both versions of your 
program again to confirm 
that they do indeed raise an 
工 OError and generate a 
traceback. 
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Add more crror-chcckiwg code... 

If you’re a fan of the “let’s not let errors happen” school of thinking, your 
first reaction will be to add extra code to check to see if the data file exists 
before you try to open it, right? 

Let’s implement this strategy. Python 5 s os module has some facilities that can 
help determine whether a data file exists, so we need to import it from the 
Standard Library, then add the required check to the code: 


七 he 


All o( *tKi 

toAt VCmarns 


o( the 

bad hews. 



「 ^ / An IDLE Session - 

A quick test of the code confirms that this new problem is dealt with properly. With this new version of your code 
in IDLE’s edit window, press F5 to confirm all is OK. 


»> 

»> 


The data file is missing! 

»> 


RESTART ==================== 

v/as c 平山 d. Cool. 
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take it to another level 


"Or add another level of exception handling 

If you are a fan of the “handle exceptions as they occur” school of thinking, you’ll 
simply wrap your code within another try statement. 



r / An IDLE Session 



Another quick test is required, this time with the version of your program that uses exception handling. Press F5 to 
give it a spin. 


»> 

»> 


The data file is missing! ^ 

»> 


- - 


RESTART ======================= 

As C 〒如 d, 铷 s vcvsiol 

V^dlcs 如 rnissma V.lc, -too. 
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So, which approach is best? 

Well.. .it depends on who you ask! Here are both versions of your code: 


^ ^ ^ sketch-extra-logic-file-missing.py - /Users/barryp/HeadFirstPython/chapter3/sk... 


import os 

if os.path.exists( ' sketch.txt 1 ) : 
data = open (' sketch.txt _ ) 


for each_line in data: 

if not each—line.find( •:' ) == -1: 

(role, linespoken) = each_line.split( ':' , 1) 
print (role, end= '' ) 
print ( ' said •, end= '' ) 
print (line_spoken, end= ' ' ) 

A ^ sketch-with-try-file-missing.py - /Users/barryp/HeadFirstPython/chapter3/sket 

data.close() 


This 

■to hahdlc File l/o J 


▽cirsioh uses cxtva | 0 ~ 匕 

CVVOVS. 


else: 

print ( 1 The datafile is missing 1 ' ) 


r 


This vmioh uses dho-thev M -tvy w 

siaie^i h> handle File I/O c^s. 



try: 

data = open (• sketch.txt ' ) 

for each 一 line in data: 
try s - 

(role, line_spoken) 
print (role,~end= '' ) 
print ( ' said ' , end= '' ) 
print (linespoken , end= 1 ' ) 
except: 
pass 

data.close() 

except: 

print ( ' The datafile is missing 1 ' ) 


each_line.split( ' : ' , 1) 


Ln: 17 Col: 0 


Let’s ask a simple question about these two versions of your program: What do each 
of these programs do? 


-Vv^rpen your pencil 


Grab your pencil. In box 1, write down what you think the 
program on the left does. In box 2, write down what you think 
the program on the right does. 
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keep it simple 


^ Sharpen your pencil 
、、 Solution 


You were to grab your pencil, then in box 1, write down what you 
thought the program on the left does. In box 2, write down what 

a lot SO you atWIy ^cd you thought the program on the right does. 

Vou^ dU 叫七咖七心心 
? vov\acd ^cv.ous ^ 

or The Code ov\ *thc vig,h*t s*tav*ts by u os w library, ar\d i*t uses w pa*tlve>Os*ts w *to 

intake sure -the da*ba -file exists, bc-forc i*t a*t*tc^p*ts -to opc^ *the da*ba -file. Eadh lme -from 
■the -file is *ther» prodesscd, bu*t o^ly a-f*tc\r it has determ med the l*mc dor\-forms *(x> *the 
vc^uircd -fo\rma*t by -firs-t -for d sih^lc u：，> dha\rad*tcv *m *tKc lme. |*f *thc u：，> is -four\d, 

{ht l*mc is processed; o*thc\ry/isc, i*t’s ignored. W\\cy\ y/cVc all doY\t, *thc daia -file is dosed. A^d 
you yt 3 -fv-ichdly message a*t *thc tv\d i-f *the -file is 竹。七 -four\d. 

h/oYZ. .• 栋 at 、 mo 代 like rb. 

⑩ 


The Code oy\ *the v-iglvt operas a da*ba -file, processes l’me m *tha 七 -file, e%*tv"ad*b *the data 
*m*tcv-es*t dr\d displays i*t oy\ sdrec^. The -file is dosed whcr\ do^e. l-f ar\y e%dcp*tiohs oCC^r, -this 
todt hdhdlcs 


Complexity is rarely a good thing 

Do you see what’s happening here? 

As the list of errors that you have to worry about grows, the complexity of 
the “add extra code and logic” solution increases to the point where it starts 
to obscure the actual purpose of the program. 

This is not the case with the exceptions handling solution, in which it’s obvious 
what the main purpose of the program is. 

By using Python’s exception-handling mechanism, you get to concentrate on 
what your code needs to do, as opposed to worrying about what can go wrong 
and writing extra code to avoid runtime errors. 

Prudent use of the try statement leads to code that is easier to read, easier 
to write, and~perhaps most important —— easier to fix when something goes 
wrong. 

Concentrate on what your code needs to do. 
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You’re done...except for owe small thing 

Your exception-handling code is good. In fact, your code might be too good in 
that it is too general. 

At the moment, no matter what error occurs at runtime, it is handled by your 
code because it’s ignored or a error message is displayed. But you really need to 
worry only about IOErrors and ValueErrors, because those are the types 
of exceptions that occurred earlier when your were developing your program. 

Although it is great to be able to handle all runtime errors, it’s probably 
unwise to be too generic.. .you will want to know if something other than 
an 工 OError or ValueError occurs as a result of your code executing at 
runtime. If something else does happen, your code might be handling it in an 
inappropriate way. 



As your code is currently written, it is too generic. Any runtime error that 
occurs is handled by one of the except suites. This is unlikely to be what 
you want, because this code has the potential to silently ignore runtime errors. 

You need to somehow use except in a less generic way. 
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specify exceptions 


Pe specific with your exceptions 

If your exception-handling code is designed to deal with a specific type of 
error, be sure to specify the error type on the except line. In doing so, you’ll 
take your exception handling code from generic to specific. 


try : 


data = open(* sketch.txt *) 

for each_line in data : 
try : 

(role, line—spoken) = each—line•split (’ 
print (role, end =’ ， ） 
print (’ said: ▼, end='') 
print(line—spoken, end='') 
except ValueError : 


pass 


data.close() 
except IOError : 



crvom you ^ c 




print ( 'The data file is missing! *) 


1 ) 




Of course, if an different type of runtime error occurs, it is no longer handled 
by your code, but at least now you’ll get to hear about it. When you are 
specific about the runtime errors your code handles, your programs no longer 
silently ignore some runtime errors. 










files and exceptions 




Your Python Toolbox 

You’ve got Chapter 3 under your 
belt and you’ve added some key 
Python techiques to your toolbox. 


f 二二 ，—一 3 

从 aUas ott^rt 


_ Noi C s 

l A ttT Pyi ot 叔喊 - 

f 故。心 

仏 Id op 匕 
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BULLET POINTS 


■ 


Use the open () BIF to open a disk file, 
creating an iterator that reads data from 
the file one line at a time. 

The readline () method reads a 
single line from an opened file. 

The seek () method can be used to 
“rewind” a file to the beginning. 

The close () method closes a 
previously opened file. 

The split () method can break a 
string into a list of parts. 

An unchangeable, constant list in Python 
is called a tuple. Once list data is 
assigned to a tuple, it cannot be changed. 
Tuples are immutable. 

A ValueError occurs when your data 
does not conform to an expected format. 

An iOError occurs when your data 
cannot be accessed properly (e.g., 
perhaps your data file has been moved or 
renamed). 

The help () BIF provides access to 
Python’s documentation within the IDLE 
shell. 

The find () method locates a specific 
substring within another string. 

The not keyword negates a condition. 

The try/except statement provides 
an exception-handling mechanism, 
allowing you to protect lines of code that 
might result in a runtime error. 

The pass statement is Python’s empty 
or null statement; it does nothing. 
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4 persistence 


禾 Saving data to files ♦ 



It is truly great to be able to process your file-based data. 

But what happens to your data when you’re done? Of course ， it’s best to save your 
data to a disk file, which allows you to use it again at some later date and time. Taking 
your memory-based data and storing it to disk is what persistence is all about. Python 
supports all the usual tools for writing to files and also provides some cool facilities for 
efficiently storing Python data. So...flip the page and let’s get started learning them. 


this is a new chapter 
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save your work 


Programs produce data 


It’s a rare program that reads data from a disk file, processes the data, and 
then throws away the processed data. Typically, programs save the data they 
process, display their output on screen, or transfer data over a network. 

You have lots o-f dhoi^s 

wh'ulh type of disk 
+ilc -to use. 



O 


0 




Before you learn what’s involved in writing data to disk, let’s process the data 
from the previous chapter to work out who said what to whom. 


When that’s done, you’ll have something worth saving. 
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persistence 


Code Magnets 



Add the code magnets at the bottom of this page to your existing 
code to satisfy the following requirements: 


1. Create an empty list called man. 

2. Create an empty list called other. 

, 一 3. Add a line of code to remove unwanted whitespace from the 

line_spoken variable. 

4. Provide the conditions and code to add line spoken to the 


correct list based on the value of role. 

5. Print each of the lists (man and other) to the screen. 


try : 

data = open('sketch.txt') 
for each—line in data : 
try : 

(role, line_spoken) = each—line•split, 1) 


except ValueError : 


pass 
data.close () 
except 工 OError: 

print ( 1 The datafile is missing! 


Hcv-c av-c Y ou,r 
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process and print 


Code Magnets Solution 



Your were to add the code magnets to your existing code to satisfy 
the following requirements: 


1. Create an empty list called man. 

2. Create an empty list called other. 

,3. Add a line of code to remove unwanted whitespace from the 

line_spoken variable. 

4. Provide the conditions and code to add line spoken to the 


correct list based on the value of role. 

5. Print each of the lists (man and other) to the screen. 



try : 

data = open('sketch.txt') 
for each—line in data : 


Assigh -the 
dipped stv-ihg « 
oh'to itscl-f 




try : 


(role, line spoken) = each line.split (' 



if role == 'Man' : 








other.append(line spoken) 


,1) 

TV 

Y/Wrbcs?ate -(•'row a sbr\Y\^ 
Uydaic OhC °*P "the lis-fcs 

based oh who said whai ， 


except ValueError : 
pass 

data.close () 


except 工 OError: 

print('The datafile is missing!') 



print(man) 


print(other) 




Covdudc — 

^v-otessed da*t3 oy \ sdrcc 灼 . 
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persistence 



Tesr DriVq 


Load your code into IDLE’s edit window and take it for a spin by pressing F5. Be sure to save your program into the 
same folder that contains sketch, txt. 


2-open-into-lists-cleaned-up.py - /Users/barryp/HeadFirstPython/chapter4/2-o... 


man =[] 
other - [] 

try: 

data = open ( ' sketch.txt ' ) 

for each—line in data: 
try : - 

(role, linespoken) = each_line.split( 's', 1) 
line spoken = line spoken.strip() 
if role == ' Man ' : — 

man.append(linespoken) 
elif role == ' Other - Man ' s 

other.append(linespoken) 
except ValueError s 
pass 


The todt ih IDLB's 

edit wihdow 



data.close() 
except IOError s 

print ( ' The datafile is missing 1 


print (man) 
print (other) 


« r> 


Python Shell 




/WHcvVs a 代 can 

OYX ok 

七 he 七叫。 


Python 3.1.2 (r312:79360M, Mar 24 2010, 01:33:18) 

[GCC 4.0.1 (Apple Inc. build 5493)] on darwin 

Type "copyright ", "credits" or "license()" for more information. 

>>> ================================ RESTART ================================ 

»> 

['Is this the right room for an argument ?', "No you haven't!", 'When?', "No yo 
u didn't 丨 "， "You didn'11", 1 You did notl ', 'Ahl (taking out his wallet and pay 
ing) Just the five minutes.'You most certainly did notl 1 , "Oh no you didn't 
1", "Oh no you didn'11", "Oh look, this isn't an argument 1", "No it isn'11"," 
It's just contradiction!", 1 It ISI ', 'You just contradicted mel•, 'You DID1 ', 

'You did just then! 1 , '(exasperated) Oh, this is futilel1 ', 'Yes it is 丨 ， ] 
["I've told you once.", 'Yes I have.', 'Just now.', 'Yes I didl_, "I'm telling 
you, I didl", "Oh I'm sorry, is this a five minute argument, or the full half 
hour?", 'Just the five minutes. Thank you .', 'Anyway, I did. 1 , "Now let's get 
one thing quite clear: I most definitely told youl", 'Oh yes I did!', 'Oh yes 
I didl ', 'Yes it is 1', "No it isn'11", 'It is NOT1', "No I didn'11", 'No no no 
1', 'Nonsensel', "No it isn't!"] 

»> 


Ln: 8 Col: 4 


It worked, as expected. 



Surely Python's open() BIF 
can open files for writing as well 
as reading, eh? 


Yes, it can. 


When you need to save data to a file, the 
open () BIF is all you need. 
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open and close 


Opew your file m write mode 

When you use the open () BIF to work with a disk file, you can specify an 
access mode to use. By default, open () uses mode r for reading, so you don’t 
need to specify it. To open a file for writing, use mode w: 



丁 he access rvtodel 
■to use 


By default, the print () BIF uses standard output (usually the screen) when 
displaying data. To write data to a file instead, use the file argument to 
specify the data file object to use: 


print("Norwegian Blues stun easily. ▼▼ 

- ^ - 


file=out) 



Wat gets wviUch -to -the -file 


When you’re done, be sure to close the file to ensure all of your data is written 
to disk. This is known as flushing and is very important: 


TV 一 c d 七 k data 
hlc objeti *to Wrbc 



This is VBRY 


whch 


wiri-tihg -to iilcs. 


6 ee} Bits - 

When you use access mode w. Python opens your named file 
for writing. If the file already exists, it is cleared of its contents, or 
clobbered. To append to a file, use access mode a, and to open a 
file for writing and reading (without clobbering), use w+. If you 
try to open a file for writing that does not already exist, it is first 
created for you, and then opened for writing. 
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persistence 


qr your pencil 



At the bottom of your program, two calls to the print () BIF 
display your processed data on screen. Let’s amend this code to 
save the data to two disk files instead. 


man 


Call your disk files man_data . txt (for what the man said) and 
other_data . txt (for what the other man said). Be sure to 
both open and close your data files, as well as protect your code 
against an IOError using try/except. 


other = 


try : 


data = open('sketch.txt') 
for each line in data : 


try : 

(role, line_spoken) = each—line.split, 1) 
line_spoken = line_spoken.strip() 
if role == 'Man 1 : 

man.append(line_spoken) 
elif role == 'Other Man 1 : 


other.append(line spoken) 


except ValueError : 
pass 
data.close () 
except IOError: 

print('The datafile is missing!') 
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save to disk 


^ Sharpen your pencil 

Solution 



man =[] 
other =[] 


At the bottom of your program, two calls to the print () BIF 
display your processed data on screen. You were to amend this 
code to save the data to two disk files instead. 

You were to call your disk files man_data . txt (for what the 
man said) and other_data . txt (for what the other man said). 
You were to make sure to both open and close your data files, as 
well as protect your code against an IOError using try/except. 


try : 


data = open('sketch.txt') 
for each_line in data : 
try : 


(role, line_spoken) = each—line.split(' 
line_spoken = line_spoken.strip() 
if role — * Man 1 : 

man.append(line_spoken) 
elif role == 'Other Man * : 

other.append(line spoken) 
except ValueEr 皿： ' 

pass 
data.close() 
except IOError: 

print('The datafile is missing! 


1) 


AH o4 - -this Code is 




\ jo\a vcw'Cw'bcv" *to open 
-f iles m ^RIT 6 wodc? 


other 一 * file 二 op ⑶ ( l o*ther—daH*t 〜 V) 

print (man, ___-file ) 

print(other, file 二 -file 



0^cy\ youv- iv/o -Piles, and assi^ 
-to -Pile objects. 

Usc ^ V'^0 W BIF io save ihe 

^ C d lists io ^cd disk -files. 


一 * filedoseO 
一 jfi ledose() 
:% dept lOBrrov '： 

evror.’) 



-fov-yt bo dose dOTW ^»lcs. 


‘die dh I/O ex 崎 ii 0 〜 should 

OhC ott\A>r. 
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persistence 



Tesr DriVq 


Perform the edits to your code to replace your two print () calls with your new file I/O code. Then, run your 
program to confirm that the data files are created: 


« o o 


chapter4 


(~> 




ODD 


mu 


O 


* 


1 ± 


A 


Back 


View 


Quick Look Action Term He re Touch 


Home 


Search 


DEVICES 

Macintosh HD 

O Paul Barry's MacBook Pro 

PLACES 

5 ^ Applications 
企 barryp 
E Desktop 
Boards 

_ Compstaff 
Q? Downloads 




pdoire youv pvogiram 浐 叫 

ho daia Ucs i h 

yowr -folder just youv- Code. 




sketch.txt 


sketch4.py 





- 


Python Shell 


thon 3.1.2 (r312:79360M, Mar 24 2010, 01:33:18) 

GCC 4.0.1 (Apple Inc. build 5493)] on darwin 
Type "copyright ", "credits" or "license()" for more information, 
»> ================================ RESTART =================== 


\M\\tr\ Y ou 圹⑽ 

youv todC) 七 Wis 
is dll you see, 
v/V^a-b looks like 

shell. 


Ln: 6 Col: 4 


A 


/Vf 七伏 youv 

v-uy\s, *b>/o -f iles avc 
CRtATEP m 70UV Wdc^r. 


#4 0 0 




Dm 


HBII 


Back 


View 


chapter4 

~q~i [w 7 ] m j ^ ^ 

Quick Look Action TermHere Touch Home Search 


DEVICES 

Macintosh HD 

O Paul Barry’s MacBook Pro 

PLACES 

S' Applications 
企 barryp 
E Desktop 
Bo ard! 

lI Compstaff 
Downloads 





1 隹 




♦ 


TXT 


TXT 


TXT 


PYTHON 


man data.txt 


other data.txt 



sketch.txt 


sketch4.py 



4 items. 100.58 G6 available 


That code worked, too. You’ve created two data files, each holding the data 
from each of your lists. Go ahead and open these files in your favorite editor 
to confirm that they contain the data you expect. 



货办〜 _ 

Consider the following carefully: what happens to 
your data files if the second call to print () in 
your code causes an 工 OError? 
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close files 


Files arc left open after aw exception! 

When all you ever do is read data from files, getting an IOError is annoying, 
but rarely dangerous, because your data is still in your file, even though you 
might be having trouble getting at it. 

It’s a different story when writing data to files: if you need to handle an 
IOError before a file is closed, your written data might become corrupted 
and there’s no way of telling until after it has happened. 


try: 

man 一 file = open ( 1 man 一 data• txt 1 , 1 w*) 

other 一 file = open(’other—data• txt’， 1 w* 

print(man, file=man 一 file) ’ 

print (other, f ile=other 一 f ile) 七 OK" 



man 一 file. close () 
other 一 file.close() 
except IOError : / 

print( 1 File error. 1 ) 


These iv/o Imcs o( Codt 

VOKT io v-uk>. 


OK 


Your exception-handling code is doing its job, but you now have a situation 
where your data could potentially be corrupted, which can’t be good. 

What’s needed here is something that lets you run some code regardless of 
whether an IOError has occured. In the context of your code, you’ll want 
to make sure the files are closed no matter what. 
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persistence 


Extcwd try with finally 

When you have a situation where code must always run no matter what errors 
occur, add that code to your try statement’s finally suite: 



If no runtime errors occur, any code in the finally suite executes. Equally, 
if an 工 OError occurs, the except suite executes and then the finally 
suite runs. 

No matter what, the code in the finally suite always runs. 

By moving your file closing code into your finally suite, you are reducing 
the possibility of data corruption errors. 

This is a big improvement, because you’re now ensuring that files are closed 
properly (even when write errors occur). 

But what about those errors? 


How do you find out the specifics of the error? 
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no dumb questiohns 


there^are no o 

Dumb Questi9ns 


I’m intrigued. When you stripped the line_spoken data 
of unwanted whitespace, you assigned the result back to the 
line_spoken variable. Surely invoking the strip() method on 
line_spoken changed the string it refers to? 

No, that’s not what happens. Strings in Python are immutable, 
which means that once a string is created, it cannot be changed. 

But you did change the line_spoken string by removing 
any unwanted whitespace, right? 

Yes and no. What actually happens is that invoking the 
strip () method on the line—spoken string creates a 
new string with leading and trailing whitespace removed. The new 
string is then assigned to line_spoken, replacing the data that 
was referred to before. In effect, it is as if you changed line_ 
spoken, when you’ve actually completely replaced the data it 
refers to. 

So what happens to the replaced data? 

Python’s built-in memory management technology reclaims the 
RAM it was using and makes it available to your program. That is, 
unless some other Python data object is also referring to the string. 

What? I don’t get it. 

It is conceivable that another data object is referring to the 
string referred to by line_spoken. For example, let’s assume 
you have some code that contains two variables that refer to the 
same string, namely “Flying Circus ■” You then decide that one of 
the variables needs to be in all UPPERCASE, so you invoke the 
upper () method on it. The Python interperter takes a copy of the 
string, converts it to uppercase, and returns it to you. You can then 
assign the uppercase data back to the variable that used to refer to 
the original data. 

And the original data cannot change, because there’s 
another variable referring to it? 

Precisely. That’s why strings are immutable, because you never 
know what other variables are referring to any particular string. 


But surely Python can work out how many variables are 
referring to any one particular string? 

It does, but only for the purposes of garbage collection. If you 
have a line of code like print (' Flying Circus ' ), the 
string is not referred to by a variable (so any variable reference 
counting that’s going on isn’t going to count it) but is still a valid string 
object (which might be referred to by a variable) and it cannot have 
its data changed under any circumstances. 

So Python variables don’t actually contain the data 
assigned to them? 

That’s correct. Python variables contain a reference to a 
data object.The data object contains the data and, because you 
can conceivably have a string object used in many different places 
throughout your code, it is safest to make all strings immutable so 
that no nasty side effects occur. 

Isn’t it a huge pain not being able to adjust strings “in 
place ”？ 

No, not really. Once you get used to how strings work, it 
becomes less of an issue. In practice, you’ll find that this issue rarely 
trips you up. 

Are any other Python data types immutable? 

Yes, a few. There's the tuple, which is an immutable list. Also, 
all of the number types are immutable. 

Other than learning which is which, how will I know when 
something is immutable? 

Don’t worry: you'll know. If you try to change an immutable 
value, Python raises a TypeError exception. 

Of course: an exception occurs. They’re everywhere in 
Python, aren’t they? 

Yes. Exceptions make the world go 'round. 
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persistence 


Knowing the type of error is wot enough 

When a file I/O error occurs, your code displays a generic “File Error” 
message. This is too generic. How do you know what actually happened? 





Who knows? 


It turns out that the Python interpreter knows.. .and it will give up the details 
if only you’d ask. 

When an error occurs at runtime, Python raises an exception of the specific 
type (such as 工 OError, ValueError, and so on). Additionally, Python 
creates an exception object that is passed as an argument to your except 
suite. 


Let’s use IDLE to see how this works. 
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idle session 



Let's see what happens when you try to open a file that doesn’t exist, such as a disk file called missing. txt. 
Enter the following code at IDLE’s shell: 

»> try: 

data = open('missing.txt') 
print(data.readline (), end:'') 
except IOError : 

print('File error') 
finally: 

data.close() 


File error 


youv- cv-v-o\r message, W 七 … 


Traceback (most recent call last) 

File "<pyshell#8 > M , line 7 , in <module> 
data.close() 

eError : name 'data' is not defined 



" wW’S this?/? 

咖山 hd it killed youv ； Codt. 


wds 


As the file doesn't exist, the data file object wasn’t created, which subsequently makes it impossible to call the 
close () method on it, so you end up with a NameError. A quick fix is to add a small test to the finally 
suite to see if the data name exists before you try to call close () .The locals () BIF returns a collection of 
names defined in the current scope. Let’s exploit this BIF to only invoke close () when it is safe to do so: 


tests 

finally: 一 - -fov- wCwbcvsW?. 

if 'data' in locals() : 
data.close () 



This is just the bit of c,odc ihai 

wds ■(» change. Pvcss Alt-P io 
you^od^i IDLB^s sMl 


File 


error 



t 如 ，七 iohs this time, 
youir tYYOY 


Here you’re searching the collection returned by the locals () BIF for the string data. If you find it, you can 
assume the file was opened successfully and safely call the close () method. 

If some other error occurs (perhaps something awful happens when your code calls the print () BIF), your 
exception-handling code catches the error, displays your "File error” message and, finally, closes any opened file. 

But you still are none the wiser as to what actually caused the error. 
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persistence 


When an exception is raised and handled by your except suite, the Python interpreter passes an exception object 
into the suite. A small change makes this exception object available to your code as an identifier: 

却 vc y 败 cx^pt, 0h ob； c ^ 

use \i as part d 

〆 〆 youv cv-\rov message- 


except IOError as err : 

print('File error : ' + err) 


But when you try to run your code with this change made, another exception is raised: 


Traceback (most recent call last) : 

File "<pyshell#18 >", line 5 , in <module> 
print('File error:' + err) 

TypeError : Can't convert 'IOError' object to str implicitly 



^oo^s! Vc-t 扣。細 , 
-tWis 


a 


This time your error message didn’t appear atoll. It turns out exception objects and strings are not compatible 
types, so trying to concatenate one with the other leads to problems. You can convert (or cast) one to the other 
using the str () BIF: 

Usc ^ BIF b> w -the 

w ㈣,。 h obje^-t io behave like a 如吋 


Now, with this final change, your code is behaving exactly as expected: 

File error : [Errno 2] No such file or directory : 'missing.txt 


ZW Y ⑽ 0 如 ㈣ a error 

wC ssaV tells you 
Y/ha 七 v/cy\*b >wv-oy>5- 


except IOError as err : 

print('File error : ' + str(err)) 





Of course, all this extra logic is starting to obscure the 
real meaning of your code. 


Wouldnt it be dreamy if there 
were a way to take advantage of 
these mechanisms without the code 
bloat? I guess ifs just a fantasy... 
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try with 


Use with to work with files 

Because the use of the try/except/finally pattern is so common when 
it comes to working with files, Python includes a statement that abstracts 
away some of the details. The with statement, when used with files, can 
dramatically reduce the amount of code you have to write, because it negates 
the need to include a finally suite to handle the closing of ^potentially 
opened data file. Take a look: 


try: 

data = open('its.txt ', "w n ) 
print("It's..• n , file=data) 
except IOError as err : 

print('File error : ' H 


str(err)) 


finally: 

if ’data’ in locals() 
data.close() 


TV»e wse VrtW, 

-fov 

如 Ul / 如 ••七 c . 


This is the usual w iv*y/ 



try: 


with open('its.txt 
print("It's ...' 
except IOError as err : 
print('File error : 


"w n ) as data 
file=data) 

+ str(err)) 


When you use with, you no longer have to worry about closing any opened 
files, as the Python interpreter automatically takes care of this for you. The 
with code on the the right is identical in function to that on the left. At Head 
First Labs, we know which approach we prefer. 


Gee| Bits - 

The with statement takes advantage of a Python technology 
called the context management protocol. 


120 Chapter 4 

















persistence 


^ Sharpen your pencil 



Grab your pencil and rewrite this try/except/finally code to use 
with instead. Here’s your code with the appropriate finally 
suite added: 


try: 

man_file = open ('man_data. txt' , ' w') 

other 一 file = open (' other 一 data• txt' , ' w') 

print(man, file=man_file) 
print(other, file=other_file) 
except IOError as err : 

print('File error : ' + str(err)) 

finally : 

if ’man—file’ in locals(): 

man_file.close() 
if 'other—file' in locals(): 
other file.close() 
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no finally 


々 、 Sharpen your pencil 

Solution 



You were to grab your pencil and rewrite this try/except/finally 
code to use with instead. Here’s your code with the appropriate 
finally suite added: 


try: 

man_file = open('man_data.txt ’， 'w') 

other 一 file = open('other 一 data•txt ’ ， 'w') 

print(man, file=man_file) 
print(other, file=other_file) 
except IOError as err : 

print('File error : ' + str(err)) 

finally : 

if ’man—file’ in locals(): 

man_file.close() 
if 'other—file' in locals() : 
other file.close() 


brf 

^evrt-'-te 巧二 .，:—) 

W ^ C wi*th 。『⑶ V) as other 一 * file: 

pv’m 七 (other, -fiIc—o-thciIc) 

七 lOEvvov as err ： 
prm-trpile error: ’ + s*br(evr)) 

Ov W >”()” tails 一 w Woic ihc use of the 仏咖 a 

Vi 七 W’ staW ⑼七 . ^ 

C ^ wi*th opCman 一 da*ta *W：' ’w’) as ma^-filc, opCo*thev 一 da*ta.*W：' V) as o-thcv^jfilc 

prm 七 f ile 二 
prm 七 (o*thev, file 二 o*thev 一 * file) 
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Tesr DriVq 


Add your with code to your program, and let’s confirm that it continues to function as expected. Delete the two 
data files you created with the previous version of your program and then load your newest code into IDLE and give 
it a spin. 


No cvvovs 1 t 



^ ^ Python Shell 

Python 3.1.2 (r312:79360M, Mar 24 2010, 01:33:18) 

[GCC 4.0.1 (Apple Inc. build 5493)] on darwin 

Type "copyright", "credits" or "license()" for more information. 

»> - RESTART - 

»> 

»> 



Ln: 6 Col: 4 

J 


If you check your folder, your two data files should've reappeared. Let’s take a closer look at the data file’s contents 
by opening them in your favorite text editor (or use IDLE). 


man_data.txt 4 - HeadFfrstPytlhon / chapter4] - VIM3 


w. 




I ' Is this the right room for an argument?', "Ht> you haven 1 11 11 , 'When?', 
"No you didn ! tI " , "You didn't S% 'You did not ! 1 , 'Ah! {taking out his 
wallet and paying) Just the five minutes. 1 , 'You most certainly did not 
1 1 , "Oh no you didn 1 1! % "Oh nt> you didn't!", "Oh look, this isn't an a 
rgument! " , "No it isn't! Ir , "It 1 s just contradiction! % 'It IS! 1 , 'You j 
ust contradicted unei 1 , 'You DID! 1 , ’You did just then! 1 , 1 (exasperated) 
Oh, this is futile* l 1 , 'Yes it is«' J 



fWs wha-t -the 

said. 


^OO other_data.txt 4= / HeadF i rstFVthor / chapter4) - VIM3 



© 


V △ ¥ ; w 




"I've told you once. 11 , 'Yes I have. ' , 'Just now.’, 'Yes I did! 


HevVs >/V\a*b 
o-b^cv- said- 




telling you, I 
the full half 
did?, _Oh yes 
'It Is ⑽ T! 1 , 1 


" I *n 

did!", 11 Oh I'm sorry, is this a five minute argument, or 
hour ？"， 'Just the five minutes. Thank you. 1 , 'Anyway, I 
I did!! 1 , ’Oh yes I did! 1 , 'Yes it is! 1 , "Mo it isn’t!% 
No I didn't®", 'Mt> no no! \ 1 Monsense! ', "No it isn’tr’l 


w 

▲ 

T 

A 


You’ve saved the lists in two files containing what the Man said and what the Other 
man said. Your code is smart enough to handle any exceptions that Python or 
your operating system might throw at it. 


Well done. This is really coming along. 


you are here ► 
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unsuitable format 


default formats arc unsuitable for files 


Although your data is now stored in a file, it’s not really in a useful format. 
Let’s experiment in the IDLE shell to see what impact this can have. 



Use a with statement to open your data file and display a single line from it: 


»> with open (' man_data. txt') as mdf : 
print(mdf.readline()) 


^ - beGuse w with w docs that (oy you. 


Wo-tc ： h o heed -to dose youv ^ 


乙 lose youv- -file 
cs that -fov vo 


['Is this the right room for an argument ?', "No you haven't!", 'When ?' r "No you didn't!", "You 
didn't!", 'You did not !', 'Ah! (taking out his wallet and paying) Just the five minutes.', 

You most certainly did not !', "Oh no you didn't !”， "Oh no you didn't!", "Oh look, this isn't 
an argument!", "No it isn't!", "It's just contradiction !", 'It IS!', 'You just contradicted 

me!', 'You DID !', 'You did just then !', '(exasperated) Oh, this is futile !!', 'Yes it is!'] 


Yikes! It would appear your list is converted to a large string by print () 
when it is saved. Your experimental code reads a single line of data from the 
file and gets all of the data as one large chunk of text.. .so much for your code 
saving your list data. 


What are your options for dealing with this problem? 



By default, print () displays your data in a format that mimics 
how your list data is actually stored by the Python interpreter. 

The resulting output is not really meant to be processed further... 
its primary purpose is to show you, the Python programmer, 
what your list data "looks like” in memory. 
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persistence 


I guess I could write some custom 
parsing code to process the ''internal 
format" used by 、、 print()〃. It shouldiVt 
take me all that long... 


O 

o 



It might be worth looking at 
using something other than a plain 
、 print ()〃 to format the data prior 
to saving it to the data file? I’d 
certainly look into it. 


O 



Parsing the data in the file is a possibility...although it’s complicated by all those 
square brackets, quotes, and commas. Writing the required code is doable, 
but it is a lot of code just to read back in your saved data. 


Of course, if the data is in a more easily parseable format^ the task would likely be 
easier, so maybe the second option is worth considering, too? 





Can you think of a function you created from earlier 
in this book that might help here? 


you are here ► 
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nonstandard output 


Why wot modify priwtJolO? 


Recall your print_lol () function from Chapter 2, which takes any list (or 
list of lists) and displays it on screen, one line at a time. And nested lists can 
be indented, if necessary. 

This functionality sounds perfect! Here’s your code from the nester . py 
module (last seen at the end of Chapter 2): 


nesteripy - Users/banryp/Downloads/niester-1.3.0/nesEer B py 


’ … i s the " nester .py 11 module and it provides one function called print_Iol () 
which prints lists that may or may not include nested lists.” 1 . 11 

def print lol( the—list f indent=False f level-0) : 
n_ _points a list of (possibly) nested lists. 

This function takes a positional argument called "the list 1 ', which 
is any Python list (of - possibly - nested lists). Each data item in the 
provided list is (recursively) printed to the screen on it 1 s own line. 

A second argument called 11 indent 1 ' controls whether or not indentation is 
shown on the display. This defaults to Falsei set it to True to switch on. 
A third argument called 11 level 11 (which defaults to 0) is used to insert 
tab-stops when a nested list is encountered. 11M11 

for each item in thelist: 
if isinstance (each_item, 
print lolj each~item f 
else: 

if indent i 

for tabstop in 
print ( 11 \t" f 
print (each item) 


Ln: 24 Col: 0 


list) ! 

indent, level+1) 


range (level) 
end- 1r ) 



$ 


TW.S code ⑽ 吻 a-.s ? lavs You^r 
data 


Amending this code to print to a disk file instead of the screen (known as 
standard output) should be relatively straightforward. You can then save your 
data in a more usable format. 


-Scliolat's tenet 



S-bdhddvd Ou*tpu*t The dc-fault pbde wheve your Code w\ri*tcs i*ts 
dd*td {ht w pv-*m*tO^ B|F is used. This is -typidally 

|h Py*thor\, s-ba^dd^d ou*tpu*t is v-c-fev-rcd bo as u sys.stdou*t w 
is ir^povtablc -from *tKc Library^ u sys w module- 
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persistence 



Let’s add a fourth argument to your print—lol () function to identify a place to write your 
data to. Be sure to give your argument a default value of sys. stdout, so that it continues to 
write to the screen if no file object is specified when the function is invoked. 


Fill in the blanks with the details of your new argument. (Note: to save on space, the comments 
have been removed from this cod, but be sure to update your comments in your nester. py 
module after you’ve amended your code.) 


def print—lol(the_list, indent=False, level=0 , 


for each_item in the—list: 

if isinstance(each—item, list) : 

print_lol(each—item, indent, level+1 
else : 

if indent : 


for tab_stop in range(level) : 
print("\t ", end ='', 
print(each—item. 



What needs to happen to the code in your with statement now that your amended print—lol () 
function is available to you? 


List the name of the module(s) that you now need to import into your program in order to support your 
amendments to print_lol (). 


you are here ► 
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extend your function 


EjceRctSe 

SotiiivoH 


o 


You were to add a fourth argument to your print_lol () function to identify a place to write 
your data to, being sure to give your argument a default value of sys. stdout so that it 
continues to write to the screen if no file object is specified when the function is invoked. 

You were to fill in the blanks with the details of your new argument. (Note: to save on space, the 
comments have been removed from this code, but be sure to update those in your nester. py 
module after you’ve amended your code). 

/\ad a^d yvc \i a 

default value. 

def print_lol (the—list, indent=False, level=0, 二 sys.stdou*t ) : 


for each—item in the—list: 

if isinstance(each—item, list) : 

print_lol(each—item, indent, level+1 
else : 


Noie: ihe 

K has 

匕 hailed. 


if indent : 

for tab_stop in range(level) : 
print("\t ", end =' ' , 
print(each—item. 



A d > 

tails 


si 七 he 七…。 
-bo 七 () 


)) 


{p use Y\C^J 





What needs to happen to the code in your with statement now that your amended print—lol () 
function is available to you? 


The Code heeds to be adjusted so 七 mstcad us*m^ *the 
u py'm*tO w BIF, todt heeds *to invoke > 狀七」 0 1()” … stead. 


List the name of the module(s) that you now need to import into your program in order to support your 
amendments to print—lol () ■ 


The p\ro<JV*am Y\Ctds *bo inaj>o\rt U hCS*tc\r W module- 
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persistence 



Tqst DriVQ 


Before taking your code for a test drive, you need to do the following: 

1. Make the necessary changes to nester and install the amended module into your Python 
environment (see Chapter 2 for a refresher on this). You might want to upload to PyPI, too. 

2. Amend your program so that it imports nester and uses print—lol () instead of print () 
within your with statement. Note: your print—lol () invocation should look something like this: 

print_lol(man, fh=man_file). 

When you are ready, take your latest program for a test drive and let’s see what happens: 


ourbpu 七 street 


只 。 ^ Python Shell 

Python 3.1.2 (r312:79360M, Mar 24 2010, 01:33s18) 

[GCC 4.0.1 (Apple Inc. build 5493)] on darwin 

Type "copyright ", "credits" or "license()" for more information. 

>>> - RESTART - 

»> 

»> 



Ln: 6 Col: 4 

/I 


Let’s check the contents of the files to see what they look like now. 




man 一 data.txt + (-/HeadFirstPython/chapter4-original) - VIM1 




9 ! O W i •• f L 一 A ¥ 一 

iht room for an araument? a 


Is this the right room for an argument? 

No you haven't! 

When? 

No you didn't! 

You didn't! 

You did not! 

Ah! (taking out his wallet and paying) Just the five minutes. 
You most certainly did not! 

Oh no you didn't! 

Oh no you didn't! 

Oh look, this isn't an argument! 

No it isn't! 

It's just contradiction! 

It IS! 

You just contradicted me! 

You DID! 

You did just then! 

(exasperated) Oh, this is futile! 

Yes it is! 


r 





hdt the 

sdid is how 
legible. 


//. 


other 一 data.txt + (-/HeadFir...thon/chapter4-original) - VIM2 





I've told you once. 

Yes I have. 

Just now. 

Yes I did! 

I'm telling you, I did! 

Oh I'm sorry, is this a five minute argument, or the full half hour? 
Just the five minutes. Thank you. 

Anyway, I did. 

Oh yes I did! 

Oh yes I did! 

Yes it is! 

No it isn't! 

It is NOT! 

No 1 didn t! the othev 




And heve s what 


No no no! 
Nonsense! 
No it isn' 





said. 


▲ 

▼ 


This is looking good. By amending your nester module, you’ve provided a 
facility to save your list data in a legible format. It’s now way easier on the eye. 


But does this make it any easier to read the data back in? 


you are here ► 
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brittle code 


Hang on a second...haven’t you been 
here before? Youve already written 
code to read in lines from a data file and 
put 'em into lists...do you like going around 
in circles?!? 



That’s a good point. 

This problem is not unlike the problem from the 
beginning of the chapter, in that you’ve got lines of 
text in a disk file that you need to process, only now 
you have two files instead of one. 

You know how to write the code to process your 
new files, but writing custom code like this is 
specific to the format that you’ve created for this 
problem. This is brittle: if the data format changes, 
your custom code will have to change, too. 

Ask yourself: is it worth it? 
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Custom Codic 

This week’s interview: 

When is custom code appropriate? 


persistence 


Head First： Hello, CC, how are you today? 

Custom Code： Hi, I’m great! And when I’m not 
great, there’s always something I can do to fix things. 
Nothing’s too much trouble for me. Here: have a 
seat. 

Head First: Why, thanks. 

Custom Code： Let me get that for you. It’s my 
new custom SlideBack& > Groove ™, the 2011 model, 
with added cushions and lumbar support...and it 
automatically adjusts to your body shape, too. How 
does that feel? 

Head First： Actually [relaxes], that feels kinda 
groovy. 

Custom Code： See? Nothing’s too much trouble 
for me. I’m your “go-to guy.” just ask; absolutely 
anything’s possible when it’s a custom job. 

Head First： Which brings me to why I’m here. I 
have a “delicate” question to ask you. 

Custom Code： Go ahead, shoot. I can take it. 

Head First： When is custom code appropriate? 

Custom Code： Isn’t it obvious? It’s always 
appropriate. 

Head First： Even when it leads to problems down 
the road? 

Custom Code： Problems?!? But I’ve already told 
you: nothing’s too much trouble for me. I live to 
customize. If it’s broken, I fix it. 

Head First： Even when a readymade solution 
might be a better fit? 

Custom Code： Readymade? You mean (I hate to 
say it): off the shelfi 

Head First： Yes. Especially when it comes to 
writing complex programs, right? 


Custom Code： What?!? That’s where I excel: 
creating beautifully crafted custom solutions for folks 
with complex computing problems. 

Head First： But if something’s been done before, 
why reinvent the wheel? 

Custom Code： But everything I do is custom- 
made; that’s why people come to me... 

Head First： Yes, but if you take advantage of other 
coders 5 work, you can build your own stuff in half 
the time with less code. You can’t beat that, can you? 

Custom Code： “Take advantage”...isn’t that like 
exploitation? 

Head First： More like collaboration, sharing, 
participation, and working together. 

Custom Code： [shocked] You want me to give my 
code.. .away? 

Head First: Well.. .more like share and share alike. 
I’ll scratch your back if you scratch mine. How does 
that sound? 

Custom Code： That sounds disgusting. 

Head First： Very droll [laughs]. All I’m saying is 
that it is not always a good idea to create everything 
from scratch with custom code when a good enough 
solution to the problem might already exist. 

Custom Code： I guess so.. .although it won’t be as 
perfect a fit as that chair. 

Head First： But I will be able to sit on it! 

Custom Code： [laughs] You should talk to my 
buddy Pickle. . .he’s forever going on about stuff like 
this. And to make matters worse, he lives in a library. 

Head First： I think I’ll give him a shout. Thanks! 

Custom Code： Just remember: you know where to 
find me if you need any custom work done. 


you are here ► 
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in a pickle 


Pickle your data 


Python ships with a standard library called pickle, which can save and load 
almost any Python data object, including lists. 

Once you pickle your data to a file, it is persistent and ready to be read into 
another program at some later date/time: 


Vouv data as •七 a^cavs 



The pickle 




['Is this the right room for an 
argument?', "No you haven't!", 
'When?', "No you didn't!", "You 
didn't!", 'You did not!', 'Ah! 
(taking out his wallet and paying) 
Just the five minutes.', 'You 
most certainly did not!', "Oh 
no you didn't !”， "Oh no you 
didn't!", "Oh look, this isn't 
an argument!", "No it isn't !”， 
"It's just contradiction!", 'It 
IS!', 'You just contradicted 
me!' , 'You DID! 1 , 'You did just 

then!', '(exasperated) Oh, this 
is futile!!', 'Yes it is!'] 



Feed youir Py-thoh 
dsia io pickle. 


Ou-t tomes i\\t 
pitklcdi MtrS\OY\ 


YouV- 

data 



You can, for example, store your pickled data on disk, put it in a database, 
or transfer it over a network to another computer. 



V^uv* dsia is v»c 匕 

,h Pythons memov-y ； 

^ati\y as bcW. 

/ 


When you are ready, reversing this process unpickles your persistent pickled 
data and recreates your data in its originalform within Python’s memory: 


YouV- 

data 


Feed youir pickled 
daia io pickle. 


Out towes 
p 外 cm mcts ：\ oy \ 
youv p»c.klcd dats. 


The y^\c\ c 


['Is this the right room for an 
argument?', "No you haven't!", 
'When? 1 , "No you didn't!", "You 
didn't!", 'You did not!', 'Ah! 
(taking out his wallet and paying) 
Just the five minutes.', 'You 
most certainly did not!', "Oh 
no you didn't!", "Oh no you 
didn't !”， "Oh look, this isn't 
an argument!", "No it isn't!", 
'It's just contradiction!", 'It 
IS!', 'You just contradicted 

me!', 'You DID!', 'You did just 

then!', '(exasperated) Oh, this 
is futile!!', 'Yes it is!'] 
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persistence 


Save with dump awd restore with load 


Using pickle is straightforward: import the required module, then use 
dump () to save your data and, some time later, load () to restore it. The 
only requirement when working with pickled files is that they have to be 
opened in binary access mode.. 


Always 

"to impoirt 

the 

module. 

save '/ouv data) 
use w duw^O , . 


挪 . 


import pickle 
» • » 

with open ('mydata .pickle(wb) as mysavedata : 
pickle.dump([1 , 2, 'three'], mysavedata) 


with open('mydata.pickle ', C^rb 1 } as myrestoredata 
a • 一 list = pickle.load(myrestoredata) 


to ^ 


print(a list) 



youv daia Y ouv 

•file usihg M loadO w . 1 


Ouc vou^ data m Y 。 W 个 

W ： i 七队 c a 吖 o 細 data object. 


cav\ 


The t c ||s 
Pythoh -to opCh 
youir daia -Piles 

眯 ode. 


What if something goes wrong? 

If something goes wrong when pickling or unpickling your data, the pickle 
module raises an exception of type PickleError. 


Here’s a snippet of your code as it currently stands. Grab your 
pencil and strike out the code you no longer need, and then 
replace it with code that uses the facilities of pickle instead. 
Add any additional code that you think you might need, too. 


as man file , open('other_data.txt ', 1 w') as other file : 

nester•print_lol(man, fh=man file) 
nester•print—lol(other, fh=other file) 
except IOError as err : 

print('File error : ' + str (err)) 


(^Sharpen your pencil 


try 


with open('man data.txt ', 1 w') 


you are here ► 
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significance of the pickle 


parpen your pencil 

Solution 


厂 碎以， 


Here's a snippet of your code as it currently stands. You were to grab 
your pencil and strike out the code you no longer need, and then 
replace it with code that uses the facilities pickle instead. You 
were also to add any additional code that you think you might need. 


impo\rt pidklc 




try : 



*bV>c autss mode -to 
be 七 caWc, Wav'/’. 



with open( ! man—data•txt 1 

^TIQG td , ~ fl I 1 1 1 


) as man file , open('other_data.txt' , 号 1 ) as other file 

pidkle.dump(m 〜 一 * file) 


«nGotGr .print lol (other；~~fh oth^ 

except IOError as err : 

print ( 'File error : ' + str (err)) 

pidklc Pidklc£\r\ro\r as pc\r\r ： 
prirrt(’Pidklm 3 error: ’ + str(pc\r\r)) 


) pidde.du 叶 (other, other 一 * file) 


Rc ? la6c W .alls *to 如 
Wi*bV^ tails -to w f'»dklc.duw\>0 . 


P u °^ ^ olr 9 ct ^ ‘dl c ahy cx^pti 0h s 

that odduv*. 



When you invoked print_lol() earlier, you provided only two arguments, even though the function signature requires you to 
provide four. How is this possible? 

When you invoke a Python function in your code, you have options, especially when the function provides default values for some 
arguments. If you use positional arguments, the position of the argument in your function invocation dictates what data is assigned to which 
argument. When the function has arguments that also provide default values, you do not need to always worry about positional arguments 
being assigned values. 

OK, you’ve completely lost me. Can you explain? 

Consider print (), which has this signature: print (value , sep = 1 ' , end = 1 \n ' A f ile=sys . stdout) . By 

default, this BIF displays to standard output (the screen), because it has an argument called file with a default value of sys . stdout. 
The file argument is the fourth positional argument. However, when you want to send data to something other than the screen, you do not need 
to (nor want to have to) include values for the second and third positional arguments. They have default values anyway, so you need to provide 
values for them only if the defaults are not what you want. If all you want to do is to send data to a file, you invoke the print () BIF like this: 
print ("Dead Parrot Sketch ", f ile = 1 myf avmonty. txt ') and the fourth positional argument uses the value 
you specify, while the other positional arguments use their defaults. In Python, not only do the BIFs work this way, but your custom functions 
support this mechamism, too. 
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persistence 



Tesr DriVq 


Let’s see what happens now that your code has been amended to use the standard pickle module instead of 
your custom nester module. Load your amended code into IDLE and press F5 to run it. 


you 

yt y\o visual 乙 la 、 

七七 sowc 七 W ， V^s 


^ Python Shell 


Python 3.1.2 (r312:79360M, Mar 24 2010, 01:33:18) 

[GCC 4.0.1 (Apple Inc. build 5493)] on darwin 

Type "copyright", "credits" or "license()" for more information. 

»> - RESTART - 

»> 

»> 



Ln: 6 Col: 4 



So, once again, let’s check the contents of the files to see what they look like now: 


« O O ^ man 一 data.txt + (~/HeadFirstPython/chapter4-original) - VIMl 


CD 




<aa>"C I q"(a{X 1 A (a"(a A (ais this the right room for an a rguinentTq'AX'O^^'taMo ^ 
you havenyou didn't Sq^X^K^^r^You di 
dn't! q^EX^L^^fpy&u did not!! (taking out his wallet and pa 
ying) Just the five minutes, cTGXH^^@You most certainly did not! q A HX A Q 
WIQh no you didn 1 1! q no you didn' t !q 

X "^"(a"(aOh look, this isn't an argument!q " KX"L"(a"(a"(BNo it isn't! l 
(T 垣 It f s just contradictionJtrMJTFVWIt :/ 一 ----- u 

icted me!q ， 0X A mrr 阶 ou DID! q A PX A R^(a A (aYou c ^ other_data.txt 4 - (~ / H ead F i rst Py th on / c h apte r4 -o ri g i n a I ) - VIM2 


T*he is the mdhs 

pickled daia. 


asperated) Oh, this is futile! 
it is! q A Se, 


q，.RX 


y ^ 



虼編 s w ¥ 





TV>c is i\\t oi\\tr 
^itklcd da*ta. 


<80>"C J 1 ve told you once.q A A?TKmYes I have.q'BX 
@Just now,q^CX 

VWYes I didlq^DX^W^^l'm telling you, I did! q A EXD^@^0h I'm sorr 
y, is this a five minute argument, or the full half h 0 ur?q A FX !ust 
the five minutes, Thank you.q A GX A M A @’0 A (^Anyway, I did. q A H)i@miiow let 1 
s get one thing quite clear: I most definitely told you!q 
yes I did!q 

X^rtTf^Oh yes I did!q-"KX 

矿垣 Yes it is !tTit isn'tSq^rK 

is NiOTIq^MX^L^cpMNo I didn't!q A 0X mN。 no nolq^PX ，垣 Xf. 
明 on sense! QX A LmNb i t isn ' t! q*Re. 


w 


T 


A 


It appears to have worked.. .but these files look like gobbledygook'. What gives? 

Recall that Python, not you, is pickling your data. To do so efficiently, Python’s 
pickle module uses a custom binary format (known as its protocol). As you 
can see, viewing this format in your editor looks decidedly weird. 


Don’t worry: it is supposed to look like this. 


you are here ► 
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idle session 


^ / An IDLE Session 


pickle really shines when you load some previously pickled data into another program. And, of course, there’s 
nothing to stop you from using pickle with nester. After all, each module is designed to serve different 
purposes. Let’s demonstrate with a handful of lines of code within IDLE’s shell. Start by importing any required 
modules: 

»> import pickle 
»> import nester 

No surprises there, eh? 

Next up: create a new identifier to hold the data that you plan to unpickle.Create an empty list called new—man: 

»> new_man =[] 

Yes, almost too exciting for words, isn't it? With your list created, let's load your pickled data into it. As you are 
working with external data files, it’s best if you enclose your code with try/except: 

»> try: 

with open('man_data.txt ', 'rb') as man_file : 

new_man = pickle.load(man_file) 
except IOError as err : 

print('File error : ' + str(err)) 

except pickle.PickleError as perr : 

print('Pickling error : ' + str(perr)) 

This code is not news to you either. However, at this point, your data has been unpickled and assigned to the 
new_man list. It's time for nester to do its stuff: 

»> nester. print 一 lol (new_man) 

Is this the right room for an argument? 

No you haven ' t! 

When? 

No you didn't! 


I^oi all -the dais is showh 
hcv-c ； but "thrust us: it’s all 
thcv-c. 


You did just then! 

(exasperated) Oh, this is futile!! 

Yes it is! 

And to finish off, let’s display the first line spoken as well as the last: 

»> print (new_man [ 0 ]) 

Is this the right room for an argument? 

»> print (new man [ -1 ]) 


Yes it is! 




~ : ^ ihai it 1S Hght ^ooJ © 
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ftcwcric file 1/0 with pickle is the way to go! 


persistence 


Now, no matter what data you create 
and process in your Python programs, 
you have a simple, tested, tried- 
and-true mechanism for saving and 
restoring your data. How cool is that? 


O 



Python takes care of your file I/O details, so you can concentrate on what 
your code actually does or needs to do. 

As you’ve seen, being able to work with, save, and restore data in lists is a 
breeze, thanks to Python. But what other data structures does Python 
support out of the box? 


Let’s dive into Chapter 5 to find out. 


you are here ► 
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python toolbox 




Your Pythow Toolbox 

You’ve got Chapter 4 under your 
belt and you’ve added some key 
Python techiques to your toolbox. 




BULLET POINTS 


a vaWe , ，。七 

:：: ri ❿户 

^ VV 06 CSS 

广二二 Aata 
一. 



The strip () method removes 
unwanted whitespace from strings. 

The file argument to the print () 
BIF controls where data is sent/saved. 

The finally suite is always executed 
no matter what exceptions occur within a 
try/except statement. 

An exception object is passed into the 
except suite and can be assigned to 
an identifier using the as keyword. 

The str () BIF can be used to access 
the stringed representation of any data 
object that supports the conversion. 

The locals () BIF returns a collection 
of variables within the current scope. 

The in operator tests for membership. 

The “+” operator concatenates two 
strings when used with strings but adds 
two numbers together when used with 
numbers. 

The with statement automatically 
arranges to close all opened files, even 
when exceptions occur. The with 
statement uses the as keyword, too. 

sys. stdout is what Python calls 
“standard output” and is available from 
the standard library’s sys module. 

The standard library’s pickle module 
lets you easily and efficiently save and 
restore Python data objects to disk. 

The pickle. dump () function saves 
data to disk. 

The pickle. load () function 
restores data from disk. 


寸 m PH. VIP 
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本 Work that data! ^ 



Data comes in all shapes and sizes, formats and encodings. 

To work effectively with your data, you often have to manipulate and transform it into a 
common format to allow for efficient processing, sorting, and storage. In this chapter, you’ll 
explore Python goodies that help you work your data up into a sweat, allowing you to 
achieve data-munging greatness. So, flip the page, and let’s not keep the coach waiting... 


this is a new chapter 
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coaching crisis 


Coach Kelly needs your help 



I*m too busy on the track 
to waste time fiddling with 
my computer. Can you help 
me process my athlete data? 


The coach is an old friend, and you’d love to help. His crack squad of U10 
athletes has been training hard. With each 600m run they do, Coach Kelly 
has recorded their time in a text file on his computer. There are four files in 
all, one each for James, Sarah, Julie, and Mikey. 






vulic . 七乂七 


1 




2 : 58 , 2 . 58 , 2 : 39 , 2 - 25 , 2 - 55 , 2 : 54 , 2 . 18 , 2 : 55 , 2:55 


九 h 







Initially, the coach needs a quick way to know the top three fastest times for each 
athlete. 

Can you help? 
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comprehending data 



Da this! 

w 


Before proceeding with this 
chapter, take a few moments 
to download the four data 
files from the Head First 
Python support website. 



Let’s begin by reading the data from each of the files into its own list. Write a short program to 
process each file, creating a list for each athlete’s data, and display the lists on screen. 

Hint: Try splitting the data on the commas, and don’t forget to strip any unwanted whitespace. 


Code here. 


you are here ► 
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let’s split 



tvtlOH 


Let’s begin by reading the data from each of the files into its own list. You were to write a short 
program to process each file, creating a list for each athlete’s data. You were then to display the 
lists on screen. ^^ 0^ -the Uc. 

ope 的 as 

— - - Read l*mc o( dlaid- 


data - ja-f rcadilmcO 




i\\t data -f iles _ 
m *buv-y\, v-cad 
七 he l*mc o-f 
da-ta -f \row 七 V^C 

石 lc, and fxtdkt 

a -f \row 七 he 

ImC 




jar«es =• daia.strip0.spli*t(V) Ccmw 七七 ^ da-ba -to a list 

opc^(julic*t^*tO as ju*f: 
daia =■ ju-f rcadlmcO 
julie 二 da*ta s*tvip0.spli*t^/) 
y/i*th op ⑶ Cikey.m as mi-f ： 
data =■ mi+.v-cadlmcO 


mikey =■ daia.s*tvip0.spli*t(V) 


y/i*th opchOsavaK.-t^) as sa-f ： 
data 二 sa-f vcadlmcO 


savah — da*tas-tvip0.spli*t^/) 


pvm 七 (ja^es) 
jprm 七 (julie) 

P n^) ^ ^~■ P ••咖 如心沾伽办你 

pr’m 七 (savah) 


D 


tWeiar 

)umb 


e no o 

Questions 


That data. strip () . split (’ ， ▼) line looks a little weird. Can you explain what’s going on? 

That’s called method chaining. The first method, strip (), is applied to the line in data, which removes any unwanted whitespace 
from the string. Then, the results of the stripping are processed by the second method, split (' , ’ ） ， creating a list. The resulting list is 
then applied to the target identifier in the previous code. In this way, the methods are chained together to produce the required result. It helps 
if you read method chains from left to right. 
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comprehending data 


p 3*01 p f f 2i01 p , 
p 3-10 p , p 2-23 p , 

F 3 ;02 p f p 3,02 p , 
r 2-55 f , f 2:54 p , 



Tesr DriVq 


Load your code into IDLE and run it to confirm that it’s all OK for now: 


Wcvcs you^* 
pv*ogira^ as 
displayed ih 
DLE. i 


0OO coacih.py - /Users/barryp/HeadFirstPython/chapterS/coach.py 


di 

I 


/W hcres 七 

yrod^cd \>y 


youv- 


todc. 



with open ( 1 james,txt 1 ) as jafi 

data = jaf.readline() 
james - data.strip)).split ) ' , 1 

with open ( F julie-txt 1 ) as juf : 

data = j uf.readline() 
julie = data.strip))-split ) 1 , 1 

with open) 'mikey.tKt' ) as mif : 

data = mif■readline() 
mikey = data.strip)).split( ' , r 


矜 oo 


with open (■ sarah.txt ■ ) as saf: 

data = saf.readline(} 
sarah = data.strip().split) 1 , 1 

print (j ames) 
print (julie) 
print (mikey) 
print (sarah) 

Python Shell 


Python 3.1,2 (r312s79360M, Mar 24 2010, 01i33 i IB) 

[GCC 4.0.1 (Apple Inc. build 5493)] on darwin 

Type '"copyright", 11 credits 11 or 11 license( ) 11 for more information 
»> =============================== RESTART ================== : 


Ln: 10 


Col: 4 


A 


So far, so good. Coach Kelly’s data is now represented by four lists in Python’s 
memory. Other than the use of method chaining, there’s nothing much new 
here, because you’ve pretty much mastered reading data from files and using 
it to populate lists. 

There’s nothing to show the coach yet, so no point in disturbing him until his 
data is arranged in ascending order, which requires you to sort it. 




2 18 
2 2 3 

■ 

3 


5 
5 
#» 

2 3 2 2 


F p p F 




5 

5 


o 1 9 
12 4 
» » #»■ 

3 3 2 2 

r p F p 


10 2 8 
0 12 1 

•» •»» 

2 3 3 2 

r p I p 


5 3 2 5 
4 2 0 2 

2 2 3 2 

F p F p 


f f f f 

4 119 
3 10 3 

» •» .»•» 

2 2 3 2 
p p p ■> 

f f f 

1118 

2 10 5 
#»»»» 

3 2 3 2 

F F F p 


4 9 2 6 

3 5 2 5 

I »#» #» 

> 2 2 2 2 A 


> p p 


f F 


> 


A! A 


Let’s look at your sorting options in Python. 
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in-place or copied sorting 


Sort iw owe of two ways 

When it comes to sorting your data using Python, you have two options. 

In-place sorting takes your data, arranges it in the order you specify, and 
then replaces your original data with the sorted version. The original ordering 
is lost. With lists, the sort () method provides in-place sorting: 


TV^co^al, 

data 





%， 




f 心 : X 


The oHgihal daia has 

how ^ ovdeved (a^d 
^UuA). 


Copied sorting takes your data, arranges it in the order you specify, and 
then returns a sorted copy of your original data. Your original data’s ordering 
is maintained and only the copy is sorted. In Python, the sorted () BIF 
supports copied sorting. 


T^co^al, 



\ 




%， 






The oHgihal, uhov-dcv-cd data 

veWms UHTOUCHBV. 


2r 

二二二 t。—). 


s v\ovi Vjccv' 
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comprehending data 


tff / An IDLE Session 


Let’s see what happens to your data when each of Python’s sorting options is used. Start by creating an unordered 
list at the IDLE shell: 


»> data = [6, 3 , 1 , 2, 4 , 5] 
»> data 

[6, 3, 1, 2, 4, 5] 


Cv'caic a list o( 
Uhoirdcircd daia 
assijh -to a vdHdble. 


Perform an in-place sort using the sort () method that is built in as standard to every Python list: 

Pe ^ W - ?L ^ ^ o, daia . 

The data^s o\rdcv-*mg has 


»> data. sort () 
»> data 


[1, 2, 3, 4, 5, 6] 

Reset data to its original unordered state, and then perform a copied sort using the sorted () BIF: 


»> data = [6, 3 , 1 , 2, 4 , 5] 
»> data 

[6, 3, 1, 2, 4, 5] 

»> data2 = sorted (data) 

»> data 

[6, 3, 1, 2, 4, 5] 头 — 

»> data2 
[1, 2, 3, 4, 5, 6] 


The data's ovdev'*^ ^as bcc^ wet. 

Pcir4 〜 COPIBD sov-tmg Oh ihc da-b. 
Same as i*t cvev- was. 

TV ^oy\cd da-ta ordered 

lov/cs 七 *to Widest 


^ Sharpen your pencil 



Either sorting option works with the coach’s data, but let’s use a 
copied sort for now to arrange to sort the data on output. In the 
space below, provide four amended print () statements to 
replace those at the bottom of your program. 
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all sorted 


4、 Sharpen your pencil 
义 Solution 


Either sorting option works with the coach’s data, but let’s use 
a copied sort for now to arrange to sort the data on output. You 
were to provide four amended print () statements to replace 
those at the bottom of your program. 


data 赃娜 


screen. 


( pr*m*t(so\rtcd(jarwCs)) 


J prm 七 (so\rted(julie)) 

. '^ ' 2 

1 prm 七 (sor 七 ed(mikey)) 

：：：：：( 

pr'm*t(so\rtcd(sarah)) 


tWeiOre no 

Dumb Qi] 


Questions 


What happens to the unsorted data when I use sort()? 


For all intents and purposes, it disappears. Python takes a copy, 
sorts it, and then replaces your original data with the sorted version. 


And there’s no way to get the original data back? 


No. If the ordering of the original data is important to you, use 
the sorted () BIF to transform your data into a sorted copy. 


6ee} Bits - 

You’ve already seen method chaining, and now it’s time to say 
"hello" to function chaining. Function chaining allows you to apply 
a series of functions to your data. Each function takes your data, 
performs some operation on it, and then passes the transformed 
data on to the next function. Unlike method chains, which read 
from left to right, function chains read from right to left (just to 
keep things interesting). 
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comprehending data 


RESTART 


f 3 i 10 p f 
F 3 , 21 p , 
， 3i02 、 
F 2i55 F , 


Look at tW.s ： Z -％ ，s 
七 V>a 七 is >Mwd- 



Ln: 10 


|a| 


/A 



Hey, it looks like your data values are 
not uniform. Is the problem with all those 
periods, dashes, and colons? 


Yes- The minute and seconds separators are 
confusing Python’s sorting technology. 

When recording his athletes’ times in each of their files, Coach 
Kelly sometimes used a different character to separate minutes 
from seconds. It looks like you need to fix your data. 


you are here 
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Tesr DriVq 


Let's see if this improves your output in any way. Make the necessary amendments to your code and 
run it. 


f ' coach2.py - /Users/barryp/JHeadFirstPython/chapterS / coach2.py 


with open ( 1 james.txt 1 } as ja£ : 

data = jaf.readline() 
james = data.strip().split( r , 1 

with open ( r julie•txt 1 } as jaf ： 
data = juf.readline() 
julie = data.strip)).split) r f 1 

with open( 'mikey.tKt' ) as mifi 
data = mif.readline() 
mikey = data.strip().split( r , 1 


with open( 'sarah.txt 1 ) as sa£: 

data = saf.readline() 
sarah = data.strip().split( r , 1 


print ( sorted ( james)) 
print j sorted j j ulie)) 
print(sorted (mikey)) 
print(sorted (sarah)) 


e 


㊃ oo 






Bui look ai Tffl 
/hc is ho i 

So ^d.Midh i Sj 

wcilrd. 




Python ShelE 


Col: 4 




f f f f 


5 

5 


r at p F 
111 
0 2 0 
» I s £ 
3 3 3 2 

f f 
r p F F 

10 2 4 
0 10 5 


- 

3 


2 3 3 2 




r p p p 

13 2 9 
0 2 0 3 

#» »v» 

2 2 3 2 


u J u u 

R F p F 
10 2 6 
2 12 5 


3 3 3 2 


f f f f 
F F F F 

5 1 1 B 
4 10 5 
» s » » 

2 2 3 2 


f Br ar Br 

F F F p 

4 9 8 B 
3 5 3 1 
» » i » 

2 2 2 2 


F p p p 

4 12 5 
3 12 5 
I * s ■ 
2 2 2 2 


4 


= p p p p 

= 2 3 9 5 

= 2 2 4 2 I 

祖 ■二 

> > 2 2 2 2 > 

zz f f f f A 

>> _ — ii — I. — - _ — - > 































time trials 


The trouble with time 


Well...there’s never enough of it, is there? 

Let’s look closely at the coach’s data to see what the problem is. Here’s Sarah 
raw data again: 


2:58,2.58,2:39,2-25,2-55,2:54,2.18,2:55,2:55 

-- 


1^ 



Recall that data read from a file comes into your program as text, so Sarah’s 
data looks like this once you turn it into a list of “times ”： 


['2:58\ '2.58' , '2:39 、 '2-25' , '2-55', '2:54 、 '2.18\ '2:55' , '2:55'] 


\ f ^ 

nese all 如呼 〆 心分如仏 aA 

-bWmks 七 Ws. 



And when you sort Sarah’s data, it ends up in this order (which isn’t quite 
what you were expecting): 


^ooysl Thsi J s 

How can Z.le 
dome a-ftev- Z — 5 弓？ 


^ 2 •:的 

ta 於’七 tome IdcWc^ 

2 ■.叨 扣 di W •七? 



o 






Python sorts the strings, and when it comes to strings, a dash comes before a 
period, which itself comes before a colon. As all the strings start with 2, the 
next character in each string acts like a grouping mechanism, with the dashed 
times grouped and sorted, then the period times, and finally the colon times. 

Nonuniformity in the coach’s data is causing the sort to fail. 
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comprehending data 


Code Magnets 



Let’s create a function called sanitize (), which takes as input 
a string from each of the athlete’s lists. The function then processes 
the string to replace any dashes or colons found with a period and 
returns the sanitized string. Note: if the string already contains a 
period, there’s no need to sanitize it. 


Rearrange the code magnets at the bottom of the page to provide 
the required functionality. 


def sanitize(time_string) : 


return(mins + '.' + secs) 

f 

^ctuirh the sahitiicd -tir^c 
七 h this -fuh^iioh. 


stv»ihg -to 


Youv avc 
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sanitzing function 


Code Magnets Solution 



You were to create a function called sanitize (), which takes 
as input a string from each of the athlete’s lists. The function then 
processes the string to replace any dashes or colons found with a 
period and returns the sanitized string. Note: if the string already 
contains a period, there’s no need to sanitize it. 

You were to rearrange the code magnets at the bottom of the 
previous page to provide the required functionality. 


def sanitize(time string) : 


Use i\\t 



in time string: 



卜 - elif >；> in time string ： 

融 vf 如 . -- g 

s*bvm5 乙 0 扒 * 

a ov- a 
toloy\. 


splitter 


r^j 





(mins , secs 



time string.split(splitter) 


return(mins + 


f f 


+ secs) 


sbc\v\^ *to 七七 he 

wmu-bes ar\d setwds wb. 


Of course, on its own, the sanitize () function is not enough. You need 
to iterate over each of your lists of data and use your new function to convert 
each of the athlete’s times into the correct format. 


Let’s put your new function to work right away. 
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comprehending data 


9^. 




Let’s write the code to convert your existing data into a sanitized version of itself. Create four 
new lists to hold the sanitized data. Iterate over each athlete’s list data and append each 
sanitized string from each list to the appropriate new list. Conclude your program by printing a 
sorted copy of each new list to the screen. 


TV^c todc 七 ha 七 
v-cads *bV)c da*ta 
-f\row *bV>c da*t3 
-f iles \rcw3ms 

*to -f >*t 

tWis pay). 


with open( 1 james.txt') as jaf: data 
james = data.strip() .split ) 
with open('julie.txt') as juf : data 
julie = data.strip().split ) 
with open('mikey.txt *) as mif : data 
mikey = data.strip() .split ( ▼, ▼) 
with open('sarah.txt') as saf : data 
sarah = data.strip() .split ) 


jaf.readline() 


juf.readline() 


mif.readline() 


saf.readline() 


'/ouv ^ 
coAt 、 



print( ) 
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sanitized for your protection 



Let’s write the code to convert your existing data into a sanitized version of itself. You were to 
create four new lists to hold the sanitized data. You were then to iterate over each athlete’s data 
and append each sanitized string from each list to an appropriate new list. You were to conclude 
your program by printing a sorted copy of each new list to the screen. 


with open('james.txt') as jaf: data 
j ames = data.strip() .split ) 
with open ( 'julie.txt') as juf : data 
julie = data.strip() .split ) 

with open('mikey.txt') as mif : data 
mikey = data.strip() .split ( ', ▼) 
with open ( 'sarah.txt') as saf : data 
sarah = data.strip() .split ) 


jaf.readline() 


juf.readline() 


mif.readline() 


saf.readline() 


Create -fouv 
cwftY lists. 




dlea^ulic =■ □ 
deah 一 mikey 二口 
c\tav\ sarah ― □ 


The y m tO w 

how 

display -the hew ^ 
sov-ted, -too. 


-for m James ： 

-for m julie: 

V) 

-for m mikey ： 

rnikcy.appchd^sar\i*ti2^(cad^ 一七 )) 
-for eadh *t m sav-ah ： 


died 妁 Sd\fdK>d 


3PPChd(sahi*tiz^( 


七)） 



從 h 0( ihe da*b items ih 

产 3 心 Mists, sawihz^ 

. 岬 pad ihe sawihz^d 

data h> the appvopviatc hew 


print( 
print( 
print( 


so\rtcd(dlcah_ja^cs) 
sov-tcd(dlcah_julie) 
so\rted(deah 一 … ikey) 


print ( so\rted^lcah_sav-ah) ) 
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comprehending data 





Lim: 10 Col: 4 



ovdcHhg woirks, bc^usc a\\ ihc 

tii^cs avc how 匕 ompdv^ble. 



Fou\r sovtcd 

lists 


This output looks much better. 

It’s taken a bit of work, but now the data from each of the four files is both 
sorted and uniformly formatted. By preprocessing your data before you 
sort it, you’ve helped ensure Python’s sorting technology performs correctly. 



Gee} BifS 


By default, both the sort () method and the sorted () 
BIF order your data in ascending order. To order your data in 
descending order, pass the reverse=True argument to 
either sort () or sorted () and Python will take care of 
things for you. 




Tesr DriVq 


Combine your sanitize () function with your amended code from the previous page, and then 
press F5 in IDLE to confirm the sorting is now working as expected. 


TV\c cmly 

as a 






Python Shell 


112 8 
2 2 2 5 


3 3 3 2 


F p p p 


f f f f 

o 1 2 B 
12 0 5 

»»»» 

3 3 3 2 

I p p I 


f f f I 

10 2 5 
0 10 5 
» » » » 

3 3 3 2 

p F p F 




T 

R 

A 

T 

s 

E 

R 


5 

5 


5 

5 



5 0 2 
4 10 

»»»» 

2 3 3 2 

p F F F 

f F F F 

4 9 1 

3 5 0 

翳 》»» 

2 2 3 2 

p F p F 

f f f 

4 3 14 

3 2 0 5 

▼ » » »» 

2 2 3 2 

■k F Bk F 


2 3 9 9 
2 2 4 3 
» » » » 

2 2 2 2 

p p p p 




2 2 2 2 


p F p F 


f f f 

112 8 

0 12 1 


> > 2 2 2 2 A 

> > F p F F > 

> > - ——:— -[ > 
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duplicated code 



Hang on a sec! Something doesn’t feel quite 
right...look at all that duplicated code, as well as 
all those duplicated lists. This duplication is bad, 
right? Is this really the best you can do? 


That’s right. Duplicated code is a problem. 

As things stand, your code creates four lists to hold the data as read 
from the data files. Then your code creates another four lists to hold 
the sanitized data. And, of course, you’re iterating all over the 
place... 

There has to be a better way to write code like this. 


Transforming lists is such a common requirement that Python 
provides a tool to make the transformation as painless as 
possible. This tool goes by the rather unwieldly name of list 
comprehension. And list comprehensions are designed to reduce 
the amount of code you need to write when transforming one list 
into another. 
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comprehending data 


Comprehending lists 

Consider what you need to do when you transform one list into another. Four 
things have to happen. You need to: 


o 

❺ 

o 

o 


Create a new list to hold the transformed data. 
Iterate each data item in the original list. 

With each iteration, perform the transformation. 
Append the transformed data to the new list. 


Create. 



clean mikey = 


for each t in mikey : 


2 - lic\r^ic. 


clean mikey.append(sanitize(each t)) 






Tv-a^ov-w. 


午 . Appchd. 


Here’s the same functionality as a list comprehension, which involves 
creating a new list by specifying the transformation that is to be applied to each 
of the data items within an existing list. 



You io pidk ihe 

use (just like with 
代 3 山 ir itevatiohs). 


clean 一 mikey = [sanitize(each t) for each t in mikey] 



A 



TV^c y \ c^i list seated. 


… by a 

七 ma 七 io 妁 • • • 


..io ea 匕 h 

data iicrw... 


… v/i*thih a" cxistihj |is*t. 


What’s interesting is that the transformation has been reduced to a single line 
of code. Additionally, there’s no need to specify the use of the append () 
method as this action is implied within the list comprehension. Neat, eh? 
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idle session 



Let's see some other list comprehension examples. Open up your IDLE shell and follow along with these one-liner 
transformations. 


Start by transforming a list of minutes into a list of seconds: 


»> mins 
»> secs 
»> secs 
[60, 120, 


=[1, 2, 3] 

=[m * 60 for m in mins] 



180] 


Simply multiply the 

啪 mute values by iQ. 


How about meters into feet? 
»> meters = [1, 10, 3] 


»> feet = 
»> feet 


[m * 3.281 for m in meters] 



[3.281, 32.81, 9.843] 



Yes, av-c 


Given a list of strings in mixed and lowercase, it’s a breeze to transform the strings to UPPERCASE: 

»> lower = [ n I n , "don' t M , "like" , "spam"] 

»> upper = [s .upper () for s in lower] 

»> upper 产二 - - -^ 败 y stirihg domes with 

['I ，， "DON'T", 'LIKE', 'SPAM'] 七 k method. 


Let's use your sanitize () function to transform some list data into correctly formatted times: 


»> dirty = 
»> clean = 


['2-22\ '2:22\ '2.22'] 
[sanitize(t) for t in dirty] 



»> clean 

[▼2.22\ '2.22', '2.22'] 


|Vs y^cvc^r so ^ *to W 
d\>rbj m-bo some 七 tlca 朽 .© 


It’s also possible to assign the results of the list transformation back onto the original target identifier. This 
example transforms a list of strings into floating point numbers, and then replaces the original list data: 


»> clean = 
»> clean 
[ 2 . 22 , 2 . 22 , 


[float(s) for s in clean] 



2 . 22 ] 


The BIF 


^Ohvcvts -to -floatihg poiht 


And, of course, the transformation can be a function chain, if that’s what you need: 


»> clean = 
»> clean 
[2.22, 3.33, 


[float(sanitize(t)) for t in [' 2-22 ', '3:33 ', '4.44']] 

4> 4 4] oy. data 

•,*tcws is su^o^rted, -too. 
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comprehending data 


^ Sharpen your pencil 



Now that you know about list comprehensions, let’s write four of 
them to process the coach’s four lists of timing values. Transform 
each of your lists into sorted, sanitized version of themselves. 
Grab your pencil and in the space provided, scribble the list 
comprehensions you plan to use. 


D 


thereicire no 

)umb Qu 


Questi9ns 


Q/ So...let me get this straight: list comprehensions are good and list iterations are bad, right? 

No, that’s not the best way to look at it. If you have to perform a transformation on every item in a list, using a list comprehension is the 
way to go, especially when the transformation is easily specified on one line (or as a function chain). List iterations can do everything that list 
comprehensions can, they just take more code, but iterations do provide more flexibility should you need it. 



6ee} Bits 


Python’s list comprehension is an example of the language’s 
support for functional programming concepts. There's plenty of 
debate about the best way to develop program code: either 
procedurally, using functional programming techniques, or 
using object orientation. At Head First Labs, we try not to get 
involved in this debate, other than to rejoice in the fact that 
Python supports, in one way or another, all three of these 
programming practices. 
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list comprehensions 


^ Sharpen your pencil 
、、 Solution 


Now that you know about list comprehensions, you were to write 
four of them to process the coach’s four lists of timing values. You 
were to transform each of your lists into sorted, sanitized version 
of themselves. You were to grab your pencil and in the space 
provided, scribble the list comprehensions you plan to use. 


TV^c list 

一心 . : so # d . as ,^ 

^ list is ordtrtd 


so\rtcd^Csahi*tiz^(*t) -for *t 

y\ julieJ) i 


so\rtcd^Csahi*tiz^(*t) -for *t 

Y\ mikey]) ( 


so\rtcd^Csahi*tiz^(*t) -for *t 

v\ sarah]) v 

) 


3hd vcpcat 



Watch it! 


Be careful about where you use 
the sorted() BIF when defining 
your list comprehensions. 


You may have been tempted to use the 
function chain sorted (sanitize (t)) 

within your list comprehension. Don’t be. Recall that the 
transformation works on one list item at a time, not the 
entire list. In this example, the sorted () BIF expects 
to sort a list, not an individual data item. 


The beauty of list comprehensions 

The use of list comprehensions with the coach’s athlete data has resulted 
in a lot less code for you to maintain. Additionally, as you get used to list 
comprehension syntax and usage, you’ll find that their use is natural and 
matches the way your brain thinks about your data and the transformations 
that you might want to apply. 

Let’s confirm that your new code is working as expected. 
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comprehending data 


j ames])) 
julie])) 
mikey])) 
sarah])) 



print(sorted ( [ sanitiEe(t) 
print(sorted( [ sanitisej t) 
print(sorted ( [ sanitise(t) 
print(sorted ( [ sanitise(t) 




data 
sarah = 


=saf.readline() 
data.strip)).split) 


RESTART 


»> 


e><ACTLV - 

same output as youv cavlicv 

list rtcvat ，。 怕 . 


Ln: 27 Col: 0 


As expected, the outout matches that from earlier. 

You’ve written a program that reads Coach Kelly’s data from his data files, 
stores his raw data in lists, sanitizes the data to a uniform format, and then 
sorts and displays the coach’s data on screen. And all in 25 lines of code. 

It’s probably safe to let the coach take a look at your output now. 



with 

d 

julie 

with 

d 

mikey 






Tesr DriVq 


Replace your list iteration code from earlier with your four new (beautiful) list comprehensions. Run 
your program to confirm that the results have not changed. 


f 、 f • coach4,py - /Users/barryp/HeadFirstPythan/chapterS/coach4.py 


def sanitisej time_string)i 
if p - r in time_stringi 
splitter - 1 
elif F i p in time_stringi 
splitter = " 

else: 

return (time_string) 

(mins, secs) = time_string.split(splitter) 
return (mins + ' . ' +^secs) 


with open ( 1 j ames.txt 1 } as jaf 
data = jaf.readline( ) 

■ _ -» B -jm ■ ■ ■ 

]ames 


Python ShelE 


nnnn 
i i i i 

1111 

r r r r 
0 000 
£ f f f 


f f f f 

5 0 2 5 
4 10 5 
»»»» 

2 3 3 2 

I p F F 


4 9 15 
3 5 0 5 


2 2 3 2 


F I p I 


112 8 

0 12 1 I 

»»»» 

> 2 2 2 2 A 

> F F r p > 

> [t t [ > 


]]]] 

112 8 
2 2 2 5 


3 3 3 2 



Iff#. 

o 1 2 B 
12 0 5 
»»»» 

3 3 3 2 

p F p F 


10 2 5 
0 10 5 
» » » » 

3 3 3 2 

V p V p 


f f f f. 

4 3 14 
3 2 0 5 
»»»» 

2 2 3 2 

F F p p 


mr f f Mr 

2 3 9 9 

2 2 4 3 

» » » » 

2 2 2 2 

p V V p 


f f f f 

1 1 B 5 

0 13 2 

» » » » 

2 2 2 2 

F p F p 


What will the coach think? 
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list slicing 



In your haste to sanitize and sort your data, you forgot to worry about what 
you were actually supposed to be doing: producing the three fastest times for each 
athlete. And, of course, there’s no place for any duplicated times in your 
output. 

Accessing the first three data items from any list is easy. Either specify each list 
item individually using the standard notation or use a list slice: 


catV) data •心 州 
you v\ccd rndWidually- 


But...what about removing duplicates from your list? 


james[0] 
james[1] 
james[2] 

james[0:3] 



Use a \\si s\\u \p attess ^ 

•rbcm 0 叶一 *bo - ^ 七一外 0 七一 
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Iterate to remove duplicates 

Processing a list to remove duplicates is one area where a list comprehension 
can’t help you, because duplicate removal is not a transformation; it’s more of 
a filter. And a duplicate removal filter needs to examine the list being created 
as it is being created, which is not possible with a list comprehension. 

To meet this new requirement, you’ll need to revert to regular list iteration 
code. 


Assume that the fourth from last line of code from your current program is changed to this: 

james = sorted([sanitize(t) for t in james]) 

That is, instead of printing the sanitized and sorted data for James to the screen, this line of 
code replaces James’s unordered and nonuniform data with the sorted, sanitized copy. 

Your next task is to write some code to remove any duplicates from the j ames list produced 
by the preceding line of code. Start by creating a new list called unique—j ames, and then 
populate it with the unique data items found in j ames. Additionally, provide code to display only 
the top three fastest times for James. 

Hint: you might want to consider using the not in operator. 



you are here ► 
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top three 



Assume that the fourth from last line of code from your current program is changed to this: 

james = sorted([sanitize(t) for t in james]) 

That is, instead of printing the sanitized and sorted data for James to the screen, this line of 
code replaces James’s unordered and non-uniform data with the sorted, sanitized copy. 

Your next task was to write some code to remove any duplicates from the j ames list produced 
by the preceding line of code. You were to start by creating a new list called unique—j ames 
and then populate it with the unique data items found in j ames. Additionally, you were to 
provide code to only display the top three fastest times for James. 


Oca 七 c 七 ^ 
CmftY list -to 

\\o\d Uc c 


— ov(Cv the 

-for ^ •. 如 d i*f "the da*ta rtem ISN’T 

. o .,.. 〆 alv-cady ttc new list.. 

I 七 Y\ot m uhi^ue 

. ’丄 . . . ... £Wc W 祕 . 


Slide the -fivs-fc 

daia items . 

-Pv-om the list av\d pr'm*t(uhi<\uc_ja^csCO ： 53) 

display -them oh 

s^v-cch. 



Da this! 


Repeat the code on this page 
for the rest of the coach’s lists: 
julie, mikey & sarah. Add 
all of your new code to your 
existing program. 
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comprehending data 


RESTART 


>>> 


0 

▲ 

T 


A 



Tesr DriVq 


Take all of the recent amendments and apply them to your program. Run this latest code within IDLE 
when you are ready. 

^ o o coachS.py - ,/Users/barryp/HeadFirstPython/chapterS/coach5.py 


james = sorted ([saniti e e(t) for t in james]) 
julie - sorted ( 丨 sanitize(tj for t in julie]) 
mikey = sorted ([sanitise(t) for t in mikey]) 
sarah = sorted ([sanitise(t) for t in sarah]) 


unique_james - [ ] 
for eacht in james: 

if each t not in unique_james t 
unique_james.appendjeach_t) 

print ( unique」ames[ 0 : 3 ]) 

unique_julie = [ ] 
for each t in julie : 

if each 一 t not in unique_j ulie : 
unique 」 ulie.append(each_t) 

print ( unique」ulie [ 0 s 3 ]) 




unique_mikey 
for eacht in mikey : 

if each t not in unique_mikey : 
unique_mikey.append(eacht) 


print (unique mikey[ 0 : 3 ]) 


unique_sarah = [ ] 
for sach ir. in sarah 

^ o o 



Soirt dhd sahitiic 
lis-fc. 


Remove 


Python Shell 


It worked! 

You are now displaying only the top three times for each athlete, and the 
duplicates have been successfully removed. 

The list iteration code is what you need in this instance. There’s a little bit of 
duplication in your code, but it’s not too bad, is it? 




4* __9- 

3 5 4 3 
» »»» 

2 2 2 2 
Flip 


4 

01 

c 

9 

6 

Ln. 


■r ar Br ar 

1 1 2 G 
0-121. 

» > > » 

>2222 > 


> 


r > 


> —- . —- —- —- > 


r 

P 


Ffff 

2 3 8 5 
2 2 3 2 
»»»■» 

2 2 2 2 

p F F F 
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duplicated code to remove duplication? 



'Not too bad’’...you’re kidding, right?!? 
Surely theres something that can be done 
with all that duplicated duplicate code? 


The irony is hard to avoid, isn’t it? 

The code that removes duplicates from your lists is itself 
duplicated. 

Sometimes such a situation is unavoidable, and sometimes 
creating a small function to factor out the duplicated code can 
help. But something still doesn’t feel quite right here... 
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comprehending data 



■ 


Wouldn t it be dreamy if there were a way to 
quickly and easily remove duplicates from an 
existing list? But I know it's just a fantasy... 
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factory functions 


Remove duplicates with sets 

In addition to lists, Python also comes with the set data structure, which 
behaves like the sets you learned all about in math class. 

The overriding characteristics of sets in Python are that the data items in a set 
are unordered and duplicates are not allowed. If you try to add a data item to a set 
that already contains the data item, Python simply ignores it. 

Create an empty set using the set () BIF, which is an example of a factory 
function.. 

Ov'CS'tc 3 hCW； 
sci, ahd 
3 

vaHablc. 




It is also possible to create 3,nd populate a set in one step. You can provide a list 
of data values between curly braces or specify an existing list as an argument 
to the set () BIF, which is the factory function.. 



‘y duplicates ih 
the supplied list 
values av 

ig^ov-cd. 


㈣ dufl^a-bcs m 
七 w jaw\cs , l»s*b ” 
Cool 



-hcholafs Cornet 



Fs6ijo\ry Function ： /\ -fad*to\ry -fuhdtioh is used *to mdke v\CY/ 
data iicr^s o-f a particular -bypc- Fo\r u sc*tO w is 

d -fad*bo\ry -fuhdtioh because i*t r^dkes a y\ey/ sc*t- |h 七 1 化 
\rC3l y/ovld, -(*3d*to\rics mdke hchdc hdme- 
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comprehending data 


Fireside Ghats 



Tonight’s talk： Does list suffer from set envy? 


List: 

[sings] “Anything you can do, I can do better. I can 
do anything better than you.” 

Can you spell “d-a-t-a 1-o-s-s ”？ Getting rid of data 
automatically sounds kinda dangerous to me. 

Seriously? 


And that’s all you do? 

And they pay you for that?!? 


Have you ever considered that I like my duplicate 
values. I’m very fond of them, you know. 

Which isn’t very often. And, anyway, I can always 
rely on the kindness of others to help me out with 
any duplicates that I don’t need. 


Set: 

I’m resisting the urge to say, “No, you can’t.” 
Instead, let me ask you: what about handling 
duplicates? When I see them, I throw them away 
automatically. 

But that’s what I’m supposed to do. Sets aren’t 
allowed duplicate values. 

Yes. That’s why I exist.. .to store sets of values. 
Which, when it’s needed, is a real lifesaver. 

That’s all I need to do. 

Very funny. You’re just being smug in an effort 
to hide from the fact that you can’t get rid of 
duplicates on your own. 


Yeah, right. Except when you don’t need them. 

I think you meant to say, “the kindness of set () ”, 
didn’t you? 



fills! 



To extract the data you need, replace 
all of that list iteration code in your 
current program with four calls to 
sorted(set (...)) [0:3]. 
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code review 




First 

Cade 取 * w 


The Head First Code Review Team has taken your code and 
annotated it in the only way they know how: they’ve scribbled 
all over it. Some of their comments are confirmations of what 
you might already know. Others are suggestions that might 
make your code better. Like all code reviews, these comments 
are an attempt to improve the quality of your code. 


I think we 
can make a few 
improvements here. 


def sanitize(time 一 string) 
if ' - ' in time 一 string: 

splitter ='-' 
elif ' : ' in time 一 string: 

splitter =' : ' 
else : 

return(time—string) 

(mins, secs) = time string.split(splitter) 
return(mins + '.' + secs) 


匕 would 
be hide io have 


O 


0 



ames 


data = j af.readline() 

=data.strip() .split {' f ') 

3 


with open (' j ames . txt' ) as jaf: 

S '^OVaV with open ('j ulie . txt' ) as juf: 

data = juf.readline() 
j ulie = data•strip()•split (’，'） 

、 

with open ( ' ) as mif : 

data = mif.readline() 
mikey = data.strip() .split {' r ' ) 




lo*t 


with open('sarah.txt') as saf : 

data = saf.readline() 
sarah = data•strip()•split) 


Mcc-t Head 
p,\rst Code Kcvicv/ 

Tc3w\- 


Ucv-cs a \>\i du^l.dat'O), V^crc. You 

douia Ubor out code mto a small 
b Ucho^ all you r^ttA ^ do is tall 
i\,t your atVMe 

dala 以 es, assi^m^ result *to a 於 

athlete list 


TV^cv-c s a 

oy \ 

vead ^ print(sorted(set([sanitize(t) for 

\v\S\dc O 认七 . 



print(sorted(set([sanitize(t) for 
print(sorted(set([sanitize(t) for 
print (sorted(set([sanitize(t) for 


t in james])) [0:3]) 
t in julie])) [0:3]) 
t in mikey])) [0:3]) 
t in sarah])) [0:3]) 



Ah, 0^. Wc get i£. 

The slide is applied io 
*thc lis*t piroduded by 

^icdCr, Hght? 




— 
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comprehending data 


9^. 




Let’s take a few moments to implement the review team’s suggestion to turn those four with 
statements into a function. Here’s the code again. In the space provided, create a function to 
abstract the required functionality, and then provide one example of how you would call your 
new function in your code: 


with open('j ames.txt') as jaf: 

data = j af.readline() 
j ames = data.strip () .split 1 ) 


with open('julie.txt') as juf : 

data = j uf.readline() 
julie = data.strip() .split { \ ' ) 


with open('mikey.txt') as mif : 

data = mif.readline() 
mikey = data.strip().split ) 


with open('sarah.txt') as saf : 

data = saf.readline() 
sarah = data.strip() .split 1 ) 


Wrbc youv 



Provide ohc 

example 匕 a ||. 
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statement to function 


EjceRctSe 
SoLuiloH 


You were to take a few moments to implement the review team’s suggestion to turn those four 
with statements into a function. In the space provided, your were to create a function to 
abstract the required functionality, then provide one example of how you would call your new 
function in your code: 


with open ('j ames.txt') as jaf: 

data = j af.readline() 
j ames = data.strip()•split(',▼) 


with open('julie.txt') as juf : 

data = j uf.readline() 
julie = data.strip()•split) 


with open('mikey.txt') as mif : 

data = mif.readline() 
mikey = data.strip() .split 1 ) 



with open ( 'sarah.txt') as saf : 

data = saf.readline() 
sarah = data.strip().split ) 

/ - d -filchdmc dS 

, 、 drf get CoacM da*ta^ileha^c )： 七 C S °* C 扣 ⑶七 . 

Create a 扒 0 — — 

•飞 . 

' ^ --- 0^^ 

wi*tK opch^ilchamc) as -P ： \rcad 

Add the suggested .. Vi . 」 • V 、 . 

. daia =lfrCadlmc0 . -the s P lii/st,i P M Gh 

C 〜 代七一 daiaii f 0. sf l•• 七 r/)) Hi : 少 “ Wm 3 4 io 

sJ 

lOBrror as ioevr: 
pr'm-tOpilc error ： 1 + st\r(ioc\r\r)) 

\rC*tu\nr\Wor\c) "fell vouv- usev aloou*t Cr^ror ^ 

(\i \i oa 炚 s) aW 代叩 。於 

{p md'ita*bc failure. 

Call'm^ m 七 1 ⑽ sarah - y 七一 doaA 一 data('sarah.*U*tO 

\s sW 吵七^ r 旅土 .…‘ ^ 

Pv * ovidc ^ ^ o( the -file io 
pv-o^css. 



170 Chapter 5 



















comprehending data 


james])) [ 0!3]) 
julie])) [ 0:3]) 
mikey])) [ 0 ! ^]) 
sarah])) [ 0:3]) 



Ln: 32 Col: 0 


print ( sorted ( set ( [ samtxze( t) 
print(sorted ( s et ( [ sanitise(t) 
print(sorted(set ( [ sanitizej t) 
print(sorted ( s et ( [ sanitizej t) 


saran = aata, strip (卜 sp 丄 



cxpc^-tcd ； youv latest 
docs the bus'mess. 
Look'mg good/ 


Excellent! 


You’ve processed the coach’s data perfectly, while 
taking advantage of the sorted () BIF, sets, 
and list comprehensions. As you can imagine, you 
can apply these techniques to many different 
situations. You’re well on your way to becoming a 
Python data-munging master'. 



Thafs great work, and just 
what I need. Thanks! I’m 
looking forward to seeing 
you on the track soon... 



Tqst DriVQ 


It’s time for one last run of your program to confirm that your use of sets produces the same results 
as your list-iteration code. Take your code for a spin in IDLE and see what happens. 


H o o coach 5 . py - /Users /barryp/HeadFirstPython/chapterS / coach 5 . py 


def sanitise) time_string) : 
if in time_stringi 

splitter = _, - f 
elif f i f in time_stringi 
splitter = r T r 
else; 

return (time_string) 

(mins, secs) = time_string,split(splitter) 
return (mins + 1 . 1 广 secs) 

with open ( 1 j ames.txt 1 ) as jaf r 

data = jaf.readline() 
james = data.strip().split( r r 1 ) 


^ ^ o 



Python Shell 






n TT 1 rp w n rp 



»> - = 

»> 

[ f 2 』 1 p , 

[ p 2.ir , 

[ p 2.22 p , 

[ p 2,IB p , 

»> 1 

r 2.22 f r 
p 2.23 p , 
P 2*3G p f 
， 2*2V , 

p 2*34 p ] 

F ] 

m p ] 

f 2,39 ， ] 



[J 

* 





Ln: 69 Col: 4 

A 


nnnn 
i i i i 

tttt 

rrrr 
0 000 
f £ f f 
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python toolbox 



Your Pythow Toolbox 

You’ve got Chapter 5 under your 
belt and you’ve added some more 
Python techiques to your toolbox. 




二 

斑 ㈣ 


*b-a^ s 


tra#W s 

■caA^ 

>\\cs a 


^ p yi l— 

參 List Corn p^ c Jj C i a \ 

㈣“ 〜心;::尸 

I ^ ^ ~ a 匕 oi^u 

:U: d d :乍 n 七 

^' hs ho Apl 城 


ohe 




BULLET POINTS 


■ The sort () method changes the 
ordering of lists in-place. 

■ The sorted () BIF sorts most any data 
structure by providing copied sorting. 

■ Pass reverse=True to either 
sort () or sorted () to arrange your 
data in descending order. 


■ 


When you have code like this: 

new_l — [] 
for t in old 1: 
new_l. 
append(len(t)) 

rewrite it to use a list comprehension, 
like this: 

new_l = [len (t) for t 
in old 1] 

To access more than one data item from 
a list, use a slice. For example: 

my_list[3:6] 

accesses the items from index location 3 
up-to-but-not-including index location 6. 

■ Create a set using the set () factory 
function. 


■ 
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6 custoni dfita objects 




本 Bundling code with data ♦ 



It’s important to match your data structure choice to your data. 

And that choice can make a big difference to the complexity of your code. In Python, 
although really useful, lists and sets aren’t the only game in town. The Python dictionary 
lets you organize your data for speedy lookup by associating your data with names, not 
numbers. And when Python’s built-in data structures don’t quite cut it, the Python class 
statement lets you define your own. This chapter shows you how. 


this is a new chapter 
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additional data 


Coach Kelly is back 
(with a wcw file format) 



I love what you've done, but I can’t tell which line 
of data belongs to which athlete, so Ive added some 
information to my data files to make it easy for you to 
figure it out. I hope this doesrVt mess things up much. 


The output from your last program in Chapter 5 was exactly what the coach 
was looking for, but for the fact that no one can tell which athlete belongs to 
which data. Coach Kelly thinks he has the solution: he’s added identification 
data to each of his data files: 


TV^'is \s w sa^ra^2-.W, 
作七⑸ added- 


Sarah Sweeney,2002-6-17,2:58,2.58,2:39,2-25,2-55,2:54,2.18,2:55,2:55,2:22,2-21,2.22 


Sdvah’s "full 






SavaV/s da*tc <^f bivtii 




If you use the split () BIF to extract Sarah’s data into a list, the first data 
item is Sarah’s name, the second is her date of birth, and the rest is Sarah’s 
timing data. 



this! 


Let’s exploit this format and see how well things work. 
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Grab the updated files from the 
Head First Python website. 













custom data objects 


Code Magnets 



Let’s look at the code to implement the strategy outlined at the bottom of the previous page. For 
now, let’s concentrate on Sarah’s data. Rearrange the code magnets at the bottom of this page to 
implement the list processing required to extract and process Sarah’s three fastest times from Coach 
Kelly’s raw data. 

Hint: the pop () method removes and returns a data item from the specified list location. 


def sanitize(time string) : 
if ' - ' in time—string: 


splitter =' - ' 
elif ' : ' in time string : 


“hitiicO” -fuhdioh is as 
i 七 was ih Chdp-tcv- 


splitter = 
else : 


return(time string) 

(mins, secs) = time 一 string.split(splitter) 
return(mins + ' • ' + secs) 


def get coach data (filename) : -- T\\C W yt_toa^_da*taO s 

try ： _ also last 七饮 . 

with open(filename) as f : 

data = f.readline() 
return(data.strip().split {',')) 
except IOError as ioerr : 

print('File error : ' + str(ioerr)) 

return(None) 




「 sarah ] 
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sarah’s times 


Code Magnets Solution 



Let’s look at the code to implement the strategy outlined earlier. For now, let’s concentrate on 
Sarah’s data. 


You were to rearrange the code magnets at the bottom of the previous page to implement the list 
processing required to extract and process Sarah’s three fastest times from Coach Kelly’s raw data. 


def sanitize(time 一 string): 
if ' - ' in time 一 string: 

splitter =' - ' 
elif ' : ' in time—string: 

splitter =' : ' 
else : 


return(time 一 string) 

(mins, secs) = time string.split(splitter) 
return(mins + '.' + secs) 


def get_coach 一 data(filename): 
try : 

with open(filename) as f : 

data = f.readline () 
return(data.strip () .split (',')) 
except 工 OError as ioerr : 

print('File error : ' + str(ioerr)) 

return (None) 


Wse the -Puh^iioh -to tuVh 

S daia Uc ihio a list, 

( 广 assign \i ^ ^ 

v^Hdble. 


TV^c tall 

vcwovcs data \row 
{\\t 心 0 灼七 。 a 
list- Tv/O tails *to 

(0)’’ v-cwovc 

七 -f 'iv-s*b *t>wo da*ta 
values ay\d assies 
*bV)Cw *to 
vav-'iablcs. 



get coach_data( ' sarah2.txt') 

B 


sarah.pop(0 >, sarah•pop(0) 



s fastest times are : 


str(sorted(set([sanitize(t) for t in sarah])) [0:3])) 


A ^us-tom message wiihih 
the “II 仫 is used 

display the results youVc 



Y. 
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Tesr DriVq 


Let’s run this code in IDLE and see what happens. 

H ^ ^ coach2.py - /Users/barryp/HeadFirstlPython/chapter6/coadi2.py 

def sanitise( time_string)i 
if F - f in time_stringi 
splitter - _p - r 
elif F i 1 in time_stringi 
splitter = = 

else: 

return (time_string) 

(mins, secs) [ time_string.split(splitter) 
return (mins + ' . 1 + secs) 

def get coach data (filename) : 
try t 

with open (filename) as f : 

data = f.readline() 
return (data,strip().split( ■ , ■ )) 
except lOError as ioerr : 

print ( 1 File errort ' + str( ioerr)) 
return (None) 

sarah = get coach data( 1 sarah2.txt r ) 

(sarah_name, sarah dob) = sarah.pop(0), sarah.pop(0) 

print (sarah name + " 1 s fastest times are i n + 

str ( sorted(set ([sanitise(t) for t in sarah])) [ 0 s 3])) 

^ 。 Python SheiE 

Python 3.1.2 (r312:79360M f Mar 24 2010, 01:33: IB) 

[GCC 4.0.1 (Apple Inc. build 5493) ] on darwin 

Type "copyright 11 , “credits 11 or ^license) ) 11 for more information. 
»> ============================== RESTART =================== 

»> 

Sarah Sweeney p s f astest times are: [ p 2 * 1G p , 1 2 *21 p , 1 2 »22 F ] 

»> I 


Ln ： 7 Col: 4 ^ 



>uir latest e,odc 




f 


TWis ou*bpw 七 
is wove 
uy\dcv-s-tay\dablc. 


This program works as expected, and is fine., .except that you have to name and create 
Sarah’s three variables in such as way that it’s possible to identify which name, date of birth, 
and timing data relate to Sarah. And if you add code to process the data for James, Julie, 
and Mikey, you’ll be up to 12 variables that need juggling. This just about works for now 
with four athletes. But what if there are 40, 400, or 4,000 athletes to process? 

Although the data is related in “real life,” within your code things are disjointed, because 
the three related pieces of data representing Sarah are stored in three separate variables. 
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keys and values 


Use a dictionary to associate data 

Lists are great, but they are not always the best data structure for every 
situation. Let’s take another look at Sarah’s data: 


£av-aWs -full Mwc 


s o-p bi\rtK 


Savah s timihg daia 


Sarah Sweeney,2002-6-17,2:58,2.58,2:39,2-25,2-55,2:54,2.18,2:55,2:55,2:22,2-21,2.22 


There’s a definite structure here: the athlete’s name, the date of birth, and 
then the list of times. 

Let’s continue to use a list for the timing data, because that still makes sense. 
But let’s make the timing data part of another data structure, which associates 
all the data for an athlete with a single variable. 

We’ll use a Python dictionary, which associates data values with keys.. 





Sarah Sweeney' 


" 2002 - 6 - 17 " 




[ 2 : 58 , 2 . 58 , 2 : 39 , 2 - 25 , 2 - 55 , 2 : 54 , 2 . 18 , 2 : 55 , 2 : 55 , 2 : 22 , 2 - 21 , 2 . 22 ] 


r Scholar's Corner 


Pid*tio^a\ry /\ buil*t 一 ih dd'bd s-t\rud*tu\rc Cmdluded v/rth 


Python) *tha 七 alloy/s you to assodiaic daia y/i-tii keys, as 
opposed to humbev-s. This lc*bs youv *m—mcmr\o\ry dd^bd 
dloscly 七 he s*t\rud*tu\rc o-f you\r 七 udl dd 七 d. 

€ W^ - 
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custom data objects 


Fireside Ghats 

、' r 


Dictionary: 


Tonight’s talk ： To use a list or not to use a list? 


List: 


Hi there, List. I hear you’re great, but not always 
the best option for complex data. That’s where I 
come in. 


What?!? Haven’t you heard? You can put anything 
into a list, anything at all. 


True. But when you do, you lose any structure 

associated with the data you are processing. n , . 

Well.. .assuming, ot course, that structure is 

important to you. 


Isn’t it always? 


Ummm, uh … I guess so. 


You guess so? When it comes to modeling your data 
in code, it’s best not to guess. Be firm. Be strong. Be 

assertive. Use a dictionary. That sounds like a slogan from one of those awful 

self-help conferences. Is that where you heard it? 


[laughs] Oh, I do love your humor, List, even when 
you know you’re on thin ice. Look, the rule is 
simple: if your data has structure, use a dictionary, not a 
list. How hard is that? 


Not that hard, really. Unless, of course, you are a 
list, and you miss being used for every piece of data 
in a program... 


Which rarely makes sense. Knowing when to use a 
list and when to use a dictionary is what separates 
the good programmers from the great ones, right? 

I guess so. Man, I do hate it when you’re right! 

取- 

The Python dictionary is known by different names in other programming languages. If you hear other 
programmers talking about a "mapping,”a "hash,” or an "associative array," they are talking about a "dictionary.” 
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idle session 



Let’s see the Python dictionary in action. Follow along with this IDLE session on your computer, ensuring that you 
get the same results as shown. 

Start by creating two empty dictionaries, one using curly braces and the other using a factory function: 

»> cleese = {} 

»> palin = diet () 

»> type (cleese) 

<class 'diet'> ^ 

»> type (palin) 

<class 'diet'> 

Add some data to both of these dictionaries by associating values with keys. Note the actual structure of the data 
is presenting itself here, as each dictionary has a Name and a list of Occupations. Note also that the palin 
dictionary is being created at the same time: 

»> cleese [' Name' ] = ' John Cleese' 

»> cleese['Occupations'] = ['actor', 'comedian ', 'writer ', 'film producer'] 

»> palin = {'Name': 'Michael Palin', 'Occupations' : ['comedian', 'actor', 'writer ', 'tv']} 


K 



Both dveate 

empty d'ul-tiohdv-y, as 
^oh-riv-med. 


With your data associated with keys (which are strings, in this case), it is possible to access an individual data item 
using a notation similar to that used with lists: 


»> palin [ 1 Name' ] ^ - 

1 Michael Palin' 

»> cleese ['Occupations ' ] [-1] 
1 film producer' 


Use s^uav-c b\radkc*ts *to mdc 乂 *m*to did*tior\av-y *to dddess 
bu*t ms-tcad mdex. v/i*th keys. 

Use v>umbcvs *bo addess a rtem s*tovcd a*t a favtidulav d*it*tiotr>av-y key- 
TKmk i\\\s as w *mdc%-dV>a*m*m5 W ay>d rtdiA -from *to Mb last 
of the assod*ia*tcd wi 七七 iom.' 


As with lists, a Python dictionary can grow dynamically to store additional key/value pairings. Let’s add some data 
about birthplace to each dictionary: 

»> palin['Birthplace'] = "Broomhill , Sheffield, England" 

»> cleese['Birthplace'] = "Weston-super-Mare , North Somerset , England" 



Unlike lists, a Python dictionary does not maintain insertion order, which can result in some unexpected 
behavior. The key point is that the dictionary maintains the associations, not the ordering: 


»> palin 

{'Birthplace': 'Broomhill , Sheffield, England ', 'Name' : 'Michael Palin ', ' Occupations' : 
[▼comedian ', 'actor ', 'writer ', 'tv']} 

»> cleese 

{'Birthplace' : 'Weston-super-Mare , North Somerset, England ', 'Name' : 'John Cleese ', 

Occupations' : ['actor ', ' comedian ', ' writer ' r 'film producer']} 

The rnamiamed by Python is 七 -P\rom lioy/ i\\t data 

v；as *mscv**tcd. Do〆 七 v/ovv*y abou*t i*tj is 0^. 
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custom data objects 


9^. 




It’s time to apply what you now know about Python’s dictionary to your code. Let’s continue to 
concentrate on Sarah’s data for now. Strike out the code that you no longer need and replace it 
with new code that uses a dictionary to hold and process Sarah’s data. 

def sanitize(time_string) : 
if 1 - * in time_string : 

splitter =' - ' 
elif ' : ' in time_string : 

splitter = ' : * 
else : 

return(time_string) 

(mins, secs) = time_string.split(splitter) 
return(mins + ' . ' + secs) 


def get_coach—data(filename): 
try : 

with open(filename) as f : 
data = f.readline() 


Stv-ikc oui ihc toAt 
you ho lohg 饮 heed. 



return(data.strip () .split (',')) 
except 工 OError as ioerr : 

print(* File error : * + str(ioerr)) 

return(None) 


sarah = get_coach_data('sarah2.txt *) 

(sarah—name, sarah—dob) = sarah•pop(0), sarah.pop (0) 


J\dd youv d'\tboY\ary 

us'm^ a 扒 d pv-otcssm^ 


todc 



print(sarah—name + "'s fastest times are : " + 

str(sorted(set([sanitize (t) for t in sarah])) [0:3])) 
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dictionary data 


ExeactSe 

Sotutvo 


It’s time to apply what you now know about Python’s dictionary to your code. Let’s continue to 
concentrate on Sarah’s data for now. You were to strike out the code that you no longer needed 
and replace it with new code that uses a dictionary to hold and process Sarah’s data. 

def sanitize(time_string) : 
if * - * in time_string : 

splitter =' - ' 
elif 1 : 1 in time_string : 

splitter =' : ' 
else : 

return(time_string) 

(mins, secs) = time_string.split(splitter) 
return(mins + '.' + secs) 


def get_coach—data(filename): 
try : 

with open(filename) as f : 

data 二 f.readline() 
return(data.strip() .split {',')) 
except 工 OError as ioerr : 

print ('File error : ' + str (ioerr)) 

return(None) 

sarah 二 get_coach_data('sarah2.txt') 

( oa-rah_namo , ~~sarah_dob)~ — a _ 丨 - [)( )p i: n 、「 

[.、h i n I i ( h j^n^rri^ + " ■ q 1 h s [.ns L Limu jQ^ ro : ~ -— 
^ b ti (sorted ( Got ([ sanitiypT^ ) 尸 nr t in 


>u dor!i heed this 

匕 ode dhymoire. 





Oca 七 c a 灼 ㈣ 切 
d 沾叫 . ^ sarah'data ^ 


-m-nln ] ；i ；i [ I I ! JT ) 


sarah—daiarU 二 Popular the d\^a n with U 

sav-ah_da*tarTimes 3 =• sarah 
pr'm*t(sarah_da-tar/Vamc^ + u, s -fas-tes-t -times arc u + 

^ s*br(so\rted(se 七 ([sahi*tiz-e(*t) for *t m sarah da*tarTinaes’]]))[0:3])) 

〜 io diVl-kibhaVy wlich. 

pv-o^cssihg the data. 〜 - 
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custom data objects 



Tesr DriVq 


Let’s confirm that this new version of your code works exactly as before by testing your code within 
the IDLE environment. 


coacih3.,py - /Users/barryp/HeadFirstPythoin/chapter6/coadi3,py 


def sanitise) time_string)i 
if ' - f in time_string: 

splitter 」 
elif F i f in time_stringi 
splitter = f 7 F " 
elssi 

return (time_string) 

(mins, secs) = time_string.split(splitter) 
return (mins + 1 , 1 + secs) 

def getcoach data (filename) : 
try i 

with open( filename) as £ : 

data = f.readline() 
return) data.strip().split( 1 , 1 )) 
except JOError as ioerr: 

print (' File errors 1 + str (ioerr)) 
return (None) 


sarah = getcoachdata ( 1 sarah2.txt ' ) 


sarah data = {} 

sarah data [ r Name' ] = sarah.pop(0) 
sarah^dataj 'DOB' ] = sarah.pop(0) 
sarah data [ 1 Timas 1 ] = sarah 



owr di 匕 tiohavv todt 


:iohav-y 
pv-odu^cs -the sd 
3s cav-licv-. 


same ircsul-ts 


print (sarah data [ 'Name' ] + ■■ 1 s fastest times are i 11 + 

strTsorted(set ( j sanitize( t) for t in sarah_data|[ F Times 1 ]l ]}) [ 0 ： 3 ] yj 


1 


^ ^ o 

Python Shell 









»> 

Sarah Sweeney p s fastest times are t 
»> 1 

— - RESTART ~ -- 

， 2.21 、 F 2,22 f ] 



I ' 

蟲 

¥ 




Ln: 4B Co [: 4 

A 




Which, again, works as expected.. .the difference being that you can now more easily 
determine and control which identification data associates with which timing data, 
because they are stored in a single dictionary. 

Although, to be honest, it does take more code, which is a bit of a bummer. Sometimes the 
extra code is worth it, and sometimes it isn’t. In this case, it most likely is. 


Let’s review your code to see if we can improve anything. 
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code review 



HeaJ fiv^t 
CaJe Review 


The Head First Code Review Team has been at it 
again: they’ve scribbled all over your code. Some 
of their comments are confirmations; others are 
suggestions. Like all code reviews, these comments 
are an attempt to improve the quality of your code. 

def sanitize(time—string): 
if ' - ' in time 一 string: 

splitter =' - ' 
elif ' : ' in time—string: 

splitter =' : ' 
else : 

return(time—string) 

(mins , secs) = time string.split(splitter) 
return(mins + ' . ' + secs) 


def get_coach 一 data(filename): 
try : 

with open(filename) as f : 

data = f.readline() 
return(data.strip() .split (',')) 
except 工 OError as ioerr : 

print ( 'File error : ' + str (ioerr)) 

return(None) 



n 






-tKa, W,ldH 如 ^ 7 - ^ 

alo^, ^ ^ do all ^ 50 ? k m 

svtuaWrt ⑽ 

七 Wis ^v-odcssm^ WilWm 

Uthor, a^a V^avc Uchor. a 

?0?u latcd as closed ^ a list 

T\\t^ all you r^ccd -to do is create 七 
didtio^avY -fv-om i\\t data -f»lc us»^^ 
a^v-o^atc tall , 叫 


print (sarah data['Name'] + n, s fastest times are : 


str(sorted(set([sanitize(t) for t in sarah data['Times 


HD) [o^Tn^ 


T 

>u m •吵七 ♦七松 ㈣ 七 his 仏如 i 山七 k y 七一 一 dataO kuho^ ioo, because doih 9 

would dh 饮 hidcly absbraci away these details. But whether you do or hot is up io you. H 

you\r Code, a-f*tc\r all/ 


so 


s 
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custom data objects 


^ Sharpen your pencil 



Actually, those review comments are really useful. Let's take the time to 
apply them to your code. There are four suggestions that you need to 
adjust your code to support: 

1. Create the dictionary all in one go. 

2. Move the dictionary creation code into the get_coach_data () 
function, returning a dictionary as opposed to a list. 

3. Move the code that determines the top three times for each athlete 
into the get_coach—data () function. 

4. Adjust the invocations within the main code to the new version of the 
get coach data () function to support it’s new mode of operation. 


Grab your pencil and write your new get_coach data () function 
in the space provided below. Provide the four calls that you’d make to 
process the data for each of the athletes and provide four amended 
print () statements: 
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reviews are in 


>>、 Sharpen your pencil 

Solution 



You were to take the time to apply the code review comments to your 
code. There were four suggestions that you needed to adjust your code 
to support: 

1. Create the dictionary all in one go. 

2. Move the dictionary creation code into the get_coach_data () 
function, returning a dictionary as opposed to a list. 

3. Move the code that determines the top three times for each athlete 
into the get_coach_data () function. 

4. Adjust the invocations within the main code to the new version of the 
get_coach_data () function to support its new mode of operation. 

You were to grab your pencil and write your new get_coach data () 
function in the space provided below, as well as provide the four calls 
that you’d make to process the data for each of the athletes and provide 
four amended print () statements: 


dc-f gc*t_doadK_da*ta^ilcr\ai^c ) ： 

brf 

wi*th as -f ： 

data =■ -fvcadl'mcO 


I Oca 七 c a -bcw^ov-av-Y =■ daia.s*brip0.spliW) 

lis 七 *to hold ^ j 

BEFORE 七叫栋 c ^turhCl Name : < 

all m one 50 . 娜 : & 叶 I w ( 0 ), 



Z * Thc dvcatioh dodc is 

how o( the Wti 


； iOh. 


'Times’: s*br(so\rted(se 七 ([sar\i*tiz>C(*t) *t m ]))[0: 多 ])}) 

{ °^. as .^：. . 汉 — es 

p\r'm*tOpilc evror: 、 + s-tv(iocr\r)) 

\rc*tu\nr\(/Vohe) 


I hC cooc ^ . - 

七 Wcc stoves is ^av-t 

*too* 


今 .Call 七 ^ 



亇 uau me 丨 …… 厂 . 」 .. 厂 ,: .………… show,h 9 0h, y li^s of 

Uar, 触七 C 一 l 二 ^oac^daia(^csl.Ui) 々 - Jode W 0hC 肀 | 士 ‘ ⑽ h 

adyUk >^ (r 、 e oi ^ W is a ^ ^ 

sta-temeyv-b as needed.. 


pr'm-t^a^csrNa^c^ + U； s -fas*tes*t -times arc ： u + jamesrTimes’]) 
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Lee s fastest txmes ares [ 2 
Jones f s fastest times are £ [ 
McManus r s fastest times are : 
Sweeney r s f astest times ares 



»> 

James 

Julie 

Mikey 

Sarah 

»> I 




RESTART 


㈣ O O 


Python Shell 


def sanitise (txme_strxng) : 
if 1 - r in time_stringi 
splitter " 

elif 1 i p in time_string: 

splitter - r 7 r = 
else: 

return (time_string) 

(mins, secs) = time_string.split(splitter) 
return (mins + 1 . ' + 一 secs) 


def get coach data (filename) i 
tryT 

with open (filename) as £ : 

data = f - readline() 
tempi = data.strip)).split( ' , 
return) { 1 Name 1 i tempi-pop(0) 


All of the daia Pvo^ssiha is 

^oved ih-to the 4h^ioh. 

’ J 


1 DOB 1 i tempi.pop( 0 ) f 
r Times 1 i str(sorted(set( [sanitiEe(t) for t in tempi])) [ 0i3])}) 
except lOError as ioerri 

print) 1 File error! ' + str (ioerr)) 
return (None) 


]ames 

julie 

mikey 

sarah 




get_coach_data( 1 james2.tKt 1 ) 
get~coach~data( 1 julie2,txt 1 ) 
get~coach~data( ' mikey2.txt 1 ) 
get 一 coach _ dataj ’ sarah2.txt 1 j 


twes. 



print (james[ 'Name 1 ] + 
print (j ulie [ r Name 1 ] + 
print (mikey [ 'Name 1 ] + 
print (sarah j ' Name 1 ]j + 


s fastest times arei 11 + james [ f Times _]} 
s fastest times are: 11 + julief r Times 1 ]) 
s fastest times are: " + mikey [ 1 Times 1 ]) 
s fastest times are ： " + sarah [ 1 Times 1 ]) 





To process additional athletes, all you need is two lines of code: the first invokes 
the get_coach_data () function and the second invokes print (). 

And if you require additional functionality, it’s no big deal to write more 
functions to provide the required functionality, is it? 
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Tesr DriVq 


«oo 


Let’s confirm that all of the re-factoring suggestions from the Head First Code Review Team are 
working as expected. Load your code into IDLE and take it for a spin. 

caaclh3c,py - / Users /barryp/HeadFiirstPyEhon/chapterG/GoachBc.py 


]8 2 
- 3 2 
] 9 » » 
r 5 2 2 

2 * I 
2 2 

0 F f ，/ 
2 F 

r f l 1 

p 3 2 
f 3 * * 
p 2 2 2 
* i I 

12 

0 p f / 
2 r 
r f 2 8 
p 2 1 
f i *» 
p 12 2 




o 2 [ n 





























associate custom code with custom data 


O 


o 



Wait a minute...youre using a dictionary to 
keep your data all in one place, but now youre 
proposing to write a bunch of custom functions 
that work on your data but aren't associated with 
it. Does that really make sense? 


Keeping your code and its data together is good. 

It does indeed make sense to try and associate the functions with the 
data they are meant to work on, doesn’t it? After all, the functions 
are only going to make sense when related to the data —— that is, the 
functions will be specific to the data, not general purpose. Because this 
is the case, it’s a great idea to try and bundle the code with its data. 

But how? Is there an easy way to associate custom code, in the form 
of functions, with your custom data? 
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custom data objects 


bundle your code and its data m a class 

Like the majority of other modern programming languages, Python lets you 
create and define an object-oriented class that can be used to associate code 
with the data that it operates on. 



Why would anyone 
want to do this? 


Using a class helps reduce complexity. 

By associating your code with the data it works on, you reduce 
complexity as your code base grows. 


So whafs the big 
deal with that? 


O 


Reduced complexity means fewer bugs. 

Reducing complexity results in fewer bugs in your code. 
However, it’s a fact of life that your programs will have 
functionality added over time, which will result in additional 
complexity. Using classes to manage this complexity is a very 
good thing. 




Fewer bugs means more maintainable code. 

Using classes lets you keep your code and your data together in 
one place, and as your code base grows, this really can make 
quite a difference. Especially when it’s 4 AM and you’re under a 
deadline … 
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get some class 


define a class 

Python follows the standard object-oriented programming model of 
providing a means for you to define the code and the data it works on as a 
class. Once this definition is in place, you can use it to create (or instantiate) 
data objects, which inherit their characteristics from your class. 


Within the object-oriented world, your code is often referred to as the class’s 
methods, and your data is often referred to as its attributes. Instantiated 
data objects are often referred to as instances. 




1 


"Sarah Sweeney" 


2002 - 6 - 17 ",[ 2 : 58 , 2 . 58 , 2 : 39 , 2 - 25 , 2 - 55 , 2 : 54 , 2 . 18 , 2 : 55 , 2 : 55 , 2 : 22 , 2 - 21 , 2 . 22 ] 



Were a^rc Youv objects, 

^\cM arc patkayd -b youv 

todt a^d i*b associated data. 


Tlic -fa^-tovy has bcch 
with youv class. 


Mikcy’s object ihS-bh^ 


Julie’s object 


>s*tay\£.c 


Each object is created from the class and shares a similar set of 
characteristics. The methods (your code) are the same in each instance, but 
each object’s attributes (your data) differ because they were created from your 
raw data. 


Let’s look at how classes are defined in Python. 
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custom data objects 


Use class to define classes 

Python uses class to create objects. Every defined class has a special method 
called_in it_() ， which allows you to control how objects are initialized. 

Methods within your class are defined in much the same way as functions, 
that is, using def. Here’s the basic form: 


TV Veiyord 
dd 1 七 10 灼 . 



与 ivc class a 

dcs^v-iptivc hdme. 


class Athlete : 





def _init_(self) : ^ 

# The code to initialize a "Athlete n object 



丁 hats a double Uhdcms^ov-c brfov 
ahd aHtv the wovd \\i , \ 




TV>c codt …七沾如 ca 乩 
object ^ocs m V^c. 


Creating object instances 


With the class in place, it’s easy to create object instances. Simply assign a call 
to the class name to each of your variables. In this way, the class (together 

with the_init_() method) provides a mechanism that lets you create 

a custom factory function that you can use to create as many object 
instances as you require: 


/\ll of tV^csc variables avc 
七 e. 




/a = Athlete () 
b = Athlete() 
c = Athlete() 
d = Athlete() 



Thc tc\\ Pythoh -to 

athlete" 

wkh is thch assia hC d -to a 
variable. 


Unlike in C ++-inspired languages, Python has no notion of defining a 
constructor called “new.” Python does object contruction for you, and then 
lets you customize your object’s initial state using the_init_() method. 
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note to self 


The importance of self 

To confirm: when you define a class you are, in effect, defining a custom factory 
function that you can then use in your code to create instances: 


a = Athlete() 


TV \\o\ds 

a *to youv- *ms*tay\tc 


When Python processes this line of code, it turns the factory function call into 
the following call, which identifies the class, the method (which is automatically 
set to in it ()), and the object instance being operated on: 


TV hdme -the 匕 lass 



卜 k, the clasps d 

TUh^xioh. 


Now take another look at how the_init_() method was defined in the 

class: 


of object *ms*tay\tc 



def _init_(self) : 

# The code to initialize an n Athlete" object. 


Check out what Python turns your object creation invocation into. Notice 
anything? 


The target identifer is assigned to the self argument. 

This is a very important argument assignment. Without it, the Python interpreter 
can’t work out which object instance to apply the method invocation to. Note 
that the class code is designed to be shared among all of the object instances: 
the methods are shared, the attributes are not. The self argument helps 
identify which object instance’s data to work on. 
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custom data objects 


Every method's first argument is self 

In fact, not only does the in it () method require self as its first 

argument, but so does every other method defined within your class. 


Python arranges for the first argument of every method to be the invoking 
(or calling) object instance. Let’s extend the sample class to store a value in a 
object attribute called thing with the value set during initialization. Another 
method, called how—big () ， returns the length of thing due to the use of 
the len () BIF: 


TV^c ViV’ todc 
assies a sullied 士 
-to a ^lass attv-ifeu-tc 
called w self . 七 . 


class Athlete : 

def init (self, value=0) 

--- ^ self, thing = value 

def how 一 big(self): 

return(len(self.thing)) 






l^oic ihc use of 

h> idchti-Py 
"the ddllih0 oljje 乙七 

•n^tah 乙 e. 


When you invoke a class method on an object instance, Python arranges for 
the first argument to be the invoking object instance, which is always assigned 
to each method’s self argument. This fact alone explains why self is 
so important and also why self needs to be the first argument to every object 
method you write: 


What you write: 


What Python executes: 
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idle session 


r / An IDLE Session 


Let’s use IDLE to create some object instances from a new class that you’ll define. Start by creating a small class 
called Athlete: 



»> class Athlete : 

def _init_(self, a_name , a_dob=None , a_times=[]): 

self, name = a_name 
self.dob = a_dob 
self.times = a times 


^ dcfauli values ^ 
two o\ the avgumchts. 





With the class defined, create two unique object instances which derive their characteristics from the Athlete 
class: 


»> sarah = Athlete('Sarah Sweeney' , '2002-6-17' , ['2:58 ', '2.58 ', '1.56']) 
»> james = Athlete (' James Jones' 

»> type (sarah) 

<class '_main_.Athlete ' > 

»> type (j ames) 

<class ' main .Athlete ' > """""J 



a*bV^lc*tcs. 


create two Uhi^uc Mlcies 
james usmg ihc default 




Even though sarah and j ames are both athletes and were created by the Athlete class's factory function, 
they are stored at different memory addreses: 


»> sarah 

< main .Athlete object at 0xl4d23f0> 


»> james 
< main 


Athlete object at 0xl4cb7d0> i\\t address 

■ 一 




Now that sarah and j ames exist as object instances, you can use the familiar dot notation to access the 
attributes associated with each: 


»> sarah.name 
Sarah Sweeney' 

»> j ames . name 
James Jones' 

»> sarah.dob 
2002-6-17' 

»> james.do 〜心， - has ho value -Pov 

»> sarah. times ° ’ So ho ^ ,h 9 ^ppcav-s oh sdvcch. 

[▼2:58 、 '2.58 \ '1.56'] 

»> james. times 

[] 
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custom data objects 


^ Sharpen your pencil 



Here’s your code (except for the santize () function, which doesn’t 
need to change). With your pencil, write code to define the Athlete 

class. In addition to the_ init _() method, define a new method 

called top3 () that, when invoked, returns the top three times. 


Be sure to adjust the get_coach_data () function to return an 
Athlete object as opposed to a dictionary, and don’t forget to amend 
your print () statements, too. 

.youv- Athlete 

乙 Idss Code 

. d 


def get_coach 一 data(filename): 
try : 

with open(filename) as f : 

data = f.readline() 
tempi = data.strip() .split (', 
return({ 1 Name' 

'DOB' 

' Times' 


as o^osed *bo a di^o^Y? 


tempi.pop(0) 
tempi.pop(0), 

str(sorted(set([sanitize(t) for t in tempi]))[0:3])}) 


except 工 OError as ioerr : 

print(* File error : ' + str (ioerr)) 

return(None) 

james = get coach data('james2.txt') 


print(james['Name'] 


s fastest times are : 


This lihe of code 
"忧 ds 匕 ioo. 

J 

james[* Times']) 


you are here ► 


195 



















class athlete 



Here’s your code (except for the santize () function, which doesn’t 
need to change). With your pencil, you were to write code to define the 

Athlete class. In addition to the_ init _() method, you were to 

define a new method called top3 () that, when invoked, returns the top 
three times. You were to be sure to adjust the get_coach_data () 
function to return an Athlete object as opposed to a dictionary, and 
you weren’t to forget to amend print (), too. 


dlass Athlete ： 


de-f 'mi*t d hdrme ； d dob—NohC, a *times 二 []) 


sel-f dob =■ a dob 


scl-f.*ti^cs =■ a *times 




pid vou v-ewcw 


to* 


drf •bop 孓 (self): 

\re*tu\nr\(so\rted(se*t([sar\i*tiz>c(*t) for 七 m self ."times])) [0:3]) 



Theve s hothihg hew as this 

CoAt t is ^ the 

IDLB sessioh. 


def get_coach 一 data(filename): 
try : 

with open(filename) as f : 

data = f.readline() 
tempi = data.strip().split ' 
return (*{ 1 r 


^ ovc ^ di^io^y 如沾 0h 

C ° L At f hd it with Aihlctc 

object ^catioh todt ihstcad. 






jy 


彻， A*Wete(te 叶 l.pop(O), te 叶 l.pop(O), tempi) 


-T 1 T-,I nmrr nn I ^ | e; ^ m ri ;m I'l ' 1 ^ fi i I 




-i i vi r n ； t ttso 


except 工 OError as ioerr : 

y\o*ta*b 。 灼 * to 3 C 七 


j ames = get_coach_data('j ames2.txt') 

james^ame - - ^ str(ja^cs.-top^O) 

print (j jjmc j + " ' s fastest times are : " + j amoo [ ' Timoc- 1 -] ) 



print('File error : 
return(None) 


* + str(ioerr)) 


Use do*b 
a*t y ouV， 


Invoke -the w -top^O w 
method 3 hd dohvcvt i-ts 
^csul-ts -fco d s-tving pviov- 
"to i*ts display on s^vcch. 
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custom data objects 


»> 

James Lee f s fastest times are ： [ p 2 
Julie Jones p s fastest times are；[ 
Mikey McManus f s fastest times are: 
Sarah Sweeney F s f astest times are ； 

»> I 


times 

are: 

" + 

str (]ames■ 

top3 ⑴） 

times 

are ； 


str j julie. 

top3 ⑴） 

times 

are: 

" + 

str (mikey. 

top3 ⑴） 

times 

are: 

" + 

str (sarah. 

top3())) 

Python Shell 




>» 


RESTART 


print (ames . name + 
print (j ulie,name + 
print (mikey.name + 
print (sarah■name + 



- Cool! TV>CV"C s 

Aa 呼 V>cv-c. 


Y\0 


0 




Tesr DriVq 


With these changes applied to your program, let’s ensure you continue to get the same results as 
earlier. Load your code into IDLE and run it. 




coach4 c py - /Users/barryp/HeadFirstPytlhon/chapter6 / coacih4,py 


class Athlete; 

def init (self r a name 
self.name = a_name 
self.dob = adob 
self.times - _ a times 


a dob=None f a times=[]) 


def top3 (self) : 

return ( sorted ( set ([sanitize(t) for t in self.times]))[0:3]) 

def get coach data( filename) i _ 丁 he Codt io ihc -fuh^tioh i 

tryS t ho ^ Aoym hcv-c, but it is s+ill D ^i J ： i>- 

with open (filename) as £ : 训 part 七 hi 

data - £.readline() ' ^ 

tempi = data.strip().split)' , 1 ) 

return( Athlete(tempi.pop(0) f tempi.pop(0), tempi)) 
except lOError as ioerri 

print ( ' File errors ' + str (ioerr)) 
return (None) 


s 


^ames 

julie 

mikey 

sarah 


get coach_data( 1 james2.tKt 1 ) 
get 二 coach=data( 1 julie2.txt 1 ) 
get~coach~data ( ' mikey2 - tKt 1 ) 
get - coach _ data ( ' sarah2,txt ' ) 



Lin: 30 


Cot '4 


And to make objects 
do more, I just add more 
methods, right? 


Yes, that’s correct: more functionality = more methods. 

Simply add methods to encapsulate the new functionality you need within 
your class. There’s no limit to how many methods a class can have, so feel 
free to knock yourself out! 
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]8 2 
F 3 2 
]9 * * 
r 5 2 2 
2 * p 
2 2 
» I i-r 

2 




p 3 2 
f 3 * * 

r 2 2 2 
* p p 

12 

* F f f 
2 pi 
r 2 @ 
p 2 1 
f X * » 

r 12 2 




o 2 rl[ 


1111 
0 0 0 0 
ee e e 
1111 
0 0 0 0 
aaaa 
f f f £ 

0 0 0 0 



























no dumb questions 


there^are no o 

Dumb Questi9ns 


I’m not sure I see why the top3() method is coded to return 
a three-item list, as opposed to a string? Surely a string would 
make the print() statement in the main program easier to write? 

It would, but it wouldn't be as flexible. By returning a list (albeit 
a small one), the top3 () method lets the calling code decide what 
happens next, as opposed to forcing the caller to work with a string. 
Granted, the current program needs to treat the list like a string, but 
not all programs will want or need to. 

Why does the class even need the top3() method? Why 
not store the top three times as an attribute within the class and 
create it as part of the object’s creation? 

Again, better not to, because doing so is less flexible. If you 
compute and store the top three times at object creation, you make it 
harder to extend the list of timing data associated with the object. 

For instance, if you add more timing data after the object is created, 
you’ll need to arrange to recompute the top three (because the new 
times might be fast) and update the attribute. However, when you 
compute the top three times “on the fly” using a call to the top3 () 
method, you always ensure you’re using the most up-to-date data. 

OK, I get that. But, with a little extra work, I could do it 
during object creation, right? 

Well, yes...but we really don’t advise that. By preserving the 
original data in each object’s attributes, you are supporting the 
extension of the class to support additional requirements in the 
future (whatever they might be). If you process the data as part of 
the object initialization code, the assumptions you make about how 
programmers will use your class might just come back to bite you. 

But what if I’m the only programmer that’ll ever use a 
custom class that I write? 

Trust us: you’ll thank yourself for coding your class to be as 
flexible as possible when you come to use it for some other purpose 
in a future project. When you are creating a class, you have no idea 
how it will be used by other programmers in their projects. And, if you 
think about, you have no idea how you might use it in the future, too. 


OK, I think Tm convinced. But tell me: how do I go about 
adding more times to my existing Athlete objects? 

To do more, add more methods. With your Athlete class 
created, it’s a breeze to extend it to do more work for you: simply add 
more methods. 

So, if you want to add a single new timing value to your times 
attribute, define a method called add—time () to do it for you. 
Additionally, you can add a list of times by defining a method called 
add_times () .Then all you need to do in your code is say 
something like this: 

sarah.add—time('1.31 *) 
to add a single time to Sarah’s timing data, or say this: 

james.add_times(['1.21' A '2.22']) 
to add a bunch of times to James's data. 

But surely, knowing that times is a list, I could write code 
like this to do the same thing? 

sarah.times.append('1.31') 
james.times.append(['1.21','2.22']) 

You could, but that would be a disaster. 

What?!? Why do you say that? There’s nothing wrong 
with my suggestion, is there? 

Well...it does indeed work. However, the problem with writing 
code like that is that it exposes (and exploits) that fact that the 
timing data is stored in a list within the Athlete class. If you 
later change your class implementation to use (for instance) a string 
instead of a list, you may well break all of the existing code that uses 
your class and that exploits the fact that the timing data is a list. 

By defining your own API with add—time () and add— 
times (), you leave open the possibility that the way the data 
is stored within your class can change in the future (obviously, only 
if such a change makes sense). It is worth noting that one of the 
reasons for using object orientation is to hide away the details of a 
class’s implementation from the users of that class. Defining your 
own API directly supports this design ideal. Exposing the internals of 
your class’s implementation and expecting programmers to exploit it 
breaks this fundamental ideal in a very big way. 
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custom data objects 


| 5 % 


Let’s add two methods to your class. The first, called add—time () ， appends a single 
additional tinning value to an athlete’s timing data. The second, add_times (), extends an 
athlete’s timing data with one or more timing values supplied as a list. 

Here’s your current class: add the code to implement these two new methods. 


class Athlete : 

def _init_(self, a_name , a—dob=None, a_times=[]): 

self.name = a_name 
self.dob = a—dob 
self.times = a_times 


def top3(self) : 

return(sorted(set([sanitize(t) for t in self.times])) [0:3]) 


f\Ad youv- 

wc 七 hcvc. 




vKSharpen your pencil 


Don’t put down the pencil just yet! Provide a few lines of code to 
test your new functionality: 
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more methods 



Let’s add two methods to your class. The first, called add—time () ， appends a single 
additional tinning value to an athlete’s timing data. The second, add_times (), extends an 
athlete’s tinning data with one of more timing values supplied as a list. 

Here’s your current class: you were to add the code to implement these two new methods. 


class Athlete : 

def _init_(self, a_name , a—dob=None, a_times=[]) : 

self.name = a_name 
self.dob = a—dob 
self.times = a_times 


def top3 (self) : 

return(sorted(set([sanitize(t) for t in self.times])) [0:3]) 



dc-f add_*tir«c^sd-f, 

use w selW !! 、 _ 

add—ti … es(sel 允 lis*t_o^ -times )： Take \'^i sullied 



sel-f *tii^cs.e%*tchdOist *times) 



values 


^ Sharpen your pencil 

Solution 



While still holding on firmly to your pencil, you were to provide a 
few lines of code to test your new functionality: 


objS ISIc - ^ 败 3 = _ 士 ( Wa 

fov \/cv-a- 败 a.add 一七 ir^n W) ^ - * Add a smjic 七 imnr^ value. 

pv*m*t(vcra *top^O) --— This will display a \\si v/rth 。七。於 value m \b 131. 

vera.add h^cs(Cl.ZZ , ) W, IZZ，]) ^ - 七⑽代七 _“3 valucs - 


p\r'mt(vc\ra.top^O) - The *tof l timnr^ sdow a 代⑽ >w: I.2J,I3I and 2..ZZ 


200 Chapter 6 

































custom data objects 



this! 


Amend your code with the updated version 
of your Athlete class before proceeding 
with this Test Drive. 




Tqst DriVQ 


After running your existing program, try out your test code in the IDLE shell to confirm that 
everything is working as expected. 




Python SheJi 


RESTART 


»> ===============； 

»> 

James Lee p s fastest times are ： [ r 2 * 01 F , f 2 * 16 F , p 2 *22 F ] 
Julie Jones p s fastest times are ： [ F 2 * 11 1 f p 2 *23 r f 1 2,59 p 
Mikey McManus 1 s fastest times ares [ ' 2 *22 f f p 2 *31 
Sarah Sweeney 1 s fastest times ares [ p 2 * 1G 1 , p 2.21 

»> vera = Athlete( r Vera Vi p ~* Ortaic a 

= vera add_time(-l 31 1 } ^ -㈣ 七 value. 

»> print (vera. top3 ( ) ) 7 J 

»> 

»> vera. add times ( [ ■ 2.22 
»> print (vera. top3 ()) 
r l,31 f f p 2-22 p 

>» I 


s 




P 2.3G f ] 

r 2.22 r 


Display -the "top "times (*thev*e’s o 灼 |y 。於, so 七 ha*t’s all you see). 

_ 1-21 11 , r 2s22 r ] }< 七 moire values. 

Pis^l^y *tiic *to^ "tKvcc (v/iVidii ， Y\o>n t m^kes d scy>sc)- 


0 


T 


In: 179 


Cot; 4 


A 


Great: it worked. 


You’ve packaged your code with your data and created a custom class 
from which you can create objects that share behaviors. And when extra 
functionality is required, add more methods to implement the required 
functionality. 

By encapsulating your athlete code and data within a custom class, you’ve 
created a much more maintainable piece of software. You will thank 
yourself for doing this when, in six months, you need to amend your code. 


Well done. This is really coming along! 
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reinventing the wheel 



Emmm...maybe I'm missing something, but 
isrVt your Athlete class wasteful? I mean, 
youve extended it with functionality thafs 
already in lists, which feels a little like 
reinventing the wheel to me... 


Yes, your Athlete class is much like a list. 

Your Athlete class does indeed behave like a list most 
of the time, and you’ve added methods to expose some list 
functionality to the users of your class. But it’s true: jow are 
reinventing the wheel here. Your add_time () method 
is a thin wrapper around the list append () method and 
your add_times () method is list’s extend () method in 
disguise. 


In fact, your Athlete class only differs from Python’s list 
due to the inclusion of the name and dob object attributes. 
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custom data objects 





Wouldn t it be dreamy if there were a 
way to extend a built-in class with custom 
attributes? But I know it's just a fantasy... 
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inherit class 


Inherit from Python's built-iw list 


Python’s class lets you create a custom class from scratchy just like you did with 
your Athlete class. However, class also lets you create a class by inheriting 
from any other existing class, including Python’s built-in data structure classes 
that provide you with list, set, and diet. Such classes are referred to as 
subclasses. 

What’s really nice is that when you inherit from an existing class (such as 
list), you are given all of the existing functionality for free. 

As your existing class is really nothing more than a list with added attributes, 
perhaps a better design is to kill off your Athlete class and replace it 
with a class that inherits from the built-in list class? It’s certainly worth 
considering, isn’t it? 





Herein lies the A thlete class. 


A short, but glittering, 
career. 


Will be missed by all who 
knew and loved him. 


Taken in his prime... 
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custom data objects 


Fireside Ghats 

、' r 


Tonight’s talk ： Inheritance, a.k.a. He looks just like his father. 


Custom Class: Inherited Class: 

Programmers like me because they get to 
control everything in their code.. .and you know 
programmers: they love to code. 

Yes, they do. But sometimes writing everything from 
scratch is not the best design decision. 

Design! Phooey! Real programmers eat, sleep, 
dream, snore, and exhale code. All that design talk 
is for people who can’t code! 

Is it really? So, you’re saying it’s much better to do 
everything from scratch and repeat the work of 
others, because your way is the best way. Are you 
serious?!? 

No, no, no: you’re not listening. It’s all done with 
control. When you build everything from the 
ground up, you’re in control, as it’s all your code. 

And you’re happy to reinvent the wheel, even 
though someone else solved that problem eons ago? 

Of course, especially when there are custom 
requirements to be taken into consideration. In that 
case, a brand-spanking new custom class is the only 
way to go. 

Not if you can extend someone else’s class to handle 
your custom requirements. That way, you get the 
best of both worlds: inheritied functionality (so 
you’re not reinventing the wheel) together with the 
custom bits. It’s a win-win situation. 

Yeah, right.. .it’s a win-win for you, not me. 


But it’s not about us: it’s to do with making the life 
of the programmer easier, even the ones that live to 
code, right? 


I guess so, although I’m still a fan of custom code ... 
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r / An IDLE Session 


Let’s see what’s involved in inheriting from Python’s built-in list class. Working in IDLE’s shell, start by creating a 
custom list derived from the built-in list class that also has an attribute called name: 

»> class NamedList - 

■ « vviun i^rin rv^r 子 1 %濤 声 丄 l *%jl i i • 

hew 


Provide the o( the class that iWis 

匕 Uss deprives -pv-orw. 


def _init_(self, a_name) : 

list._init_([] 

self.name = a name 卜 rbalizjC dcV"Wcd dldss, a 灼 d 


assij^ i\\t av-jumch-t -to tV^c atbribute. 


With your NamedList class defined, use it to create an object instance, check the object’s type (using the 
type () BIF), and see what it provides (using the dir () BIF): 

»> johnny = NamedList("John Paul Jones") 

»> type (johnny) 

<class '_main_.NamedList'> ^^. 

»> dir (j ohnny) 

[' add ', ' class ', ' contains ', ' delattr ', ' delitem ', ' diet ', ' doc 


Cvcatc a hew 'Wa^cdLisF object ihs-bhdc. 


Yes, w joVmny’ is a u NamcdUs*t w . 


_eq;_ ' , ' _format_' , '_ge_ ' , ' _getattribute_' , '_getitem_' , '_gt_ ' , ' _hash_ ' , 

_iadd ' , '_imul_' , '_init_' , '_iter_' , ' le ' , ' len_' , '_It_' , '_module_ ', 

mul_' , ' _ne_' , ' _new_' , '_reduce_' r ' reduce_ex ' , '_repr_' , '_reversed_ ', 

rmul_' , ' _setattr_’，'_setitem_' f '_sizeof ' , ' str ' , ' _subclasshook_ ’， 

_weakref_ ', ’append', 'count ', 'extend', 'index ', 'insert', 'name ', 'pop ', 'remove ', 

reverse' , ' sort' ] ^ 

W、do eve,ythi， 9 a list as well as sW data i, 編士 . 

Use some of the functionality supplied by the list class to add to the data stored in j ohnny: 

johnny.appendrBass Player^) Add data ^ 

»> johnny.extend(['Composer' , ” Arranger' ” Musician”])) pyoVidcd by tViC list built m- 

»> j ohnny 


['Bass Player ', 'Composer ', 'Arranger ', 'Musician'] 
»> j ohnny. name 
1 John Paul Jones' — 


A^css the list ds well Ss 
the attribute data. 


Because j ohnny is a list, it’s quite OK to do list-type things to it: 


»> for attr in johnny: 

print(johnny.name 


is a " + attr + 


like a^Y list, so -feel 

use *rb v/Kc\rcvcv yo^d use a list 


John Paul Jones is a Bass Player 
John Paul Jones is a Composer. 
John Paul Jones is a Arranger. 
John Paul Jones is a Musician. 


t 
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JoV^^s a busy boy. © 














custom data objects 


■ 


Here is the code for the now defunct Athlete class. In the space provided below, rewrite this 
class to inherit from the built-in list class. Call your new class AthleteList. Provide a 
few lines of code to exercise your new class, too: 

class Athlete : 

def _init_(self, a_name, a—dob=None, a_times=[]) : 

self.name = a_name 
self.dob = a_dob 
self.times = a_times 


def top3(self) : 

return(sorted(set([sanitize(t) for t in self.times]))[0:3]) 


def add—time(self, time_value) : 
self.times.append(time_value) 


Wrbc youv 
tlass todt V\cv-c. 




def add—times(self, list_of_times) : 
self.times.extend(list_of—times) 


youv- 

匕 。 de hcv-c. 
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new athlete list 



IvtlOH 


Here is the code for the now defunct Athlete class. In the space provided below, you were 
to rewrite this class to inherit from the built-in list class. You were to call your new class 
AthleteList ， as well as provide a few lines of code to exercise your new class: 

class Athlete : 

def _init_(self, a_name, a—dob=None, a_times=[]): 

self.name = a_name 
self.dob = a dob 



def top3 (self) : 

return(sorted(set([sanitize(t) for t in 




time (self f time value) : 


(^sel) [0:3]) 


TV tlass 


def adjd. times list of times) : 

fes .^xterxi>^istw<rr -wmes 


These 
methods 
aireh’t heeded 
5 hyrno\rc. 


卜 kvi 七 class’ 


dlass ^hlcteListOist )： 

dc-f 'mi*t (self, a hdrmC ； d dob 二 /Vohe, a *tir^s 二 []): 

hew hen. C “s 七.一 Jy^i_CO) 

WamcdList” ihit todc / scl^.dob =■ a—dob 

scl-f.e%*tcr\d^a -times) 


"this toAt is vcv~y 
similav -fcp.ihc ..… 


Use *tV)C r\CW 
dlass^s y\ 3 w>C 


d^f *top;(sel*f): 

re*tu\rh(so\rted(se 七 ([sahi*tiz^(*t) iov* *t m/sel-f]) KOZS) 




The daia 

itscl-f is the 

Wmg daia, 
s o "the W- timcs J 
^ttv-ibutc is 
gohe. 


vev-a =■ Aihlg*bgLisfc(Ve\ra \A’) 
vcraappchd^l^r) 
prm 七 (ver a. *bop 冬 0 ) 


Koy/ so\A f rt ygv-aaffe^d 131) . 〔 TV^todc docs a job d 

•Vvow\ owiwk-l-^4-y\o^O^ / yo^f" y\C^t £-l3ss. 


二 St:'!?’ ^ vera ： e^(rZ^ 

mC't^ods "to 
youv v/ovk ov\- 


p\rm 七 (\zera. *bop 冬 0 ) 
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custom data objects 



this! 


In your code, replace your Athlete 
class code with your new AthleteList 
class code, and don’t forget to change 
get_coach—data () to return an 
AthleteList object instance as 
opposed to an Athlete object instance. 


D 


theveictr 

)umb 


e no o 

Questions 


Sorry...but not three minutes ago you were telling me not 
to expose the inner workings of my class to its users, because 
that was fundamentally a bad idea. Now you’re doing the exact 
opposite! What gives? 

Well spotted. In this particular case, it's OK to expose the fact 
that the class is built on top of list. This is due to the fact that the 
class is deliberately called AthleteList to distinguish it from 
the more generic Athlete class. When programmers see the 
word “list” in a class name, they are likely to expect the class to work 
like a list and then some. This is the case with AthleteList. 

And I can inherit from any of the built-in types? 

Yes. 

What about inheriting from more than one class...does 
Python support multiple interitance? 

Yes, but it’s kind of scary. Refer to a good Python reference text 
for all the gory details. 




Can I inherit from my own custom classes? 


Of course, that’s the whole idea. You create a generic class 
that can then be “subclassed” to provide more specific, targeted 
functionality. 




Can I put my class in a module file? 


Yes, that’s a really good idea, because it lets you share your 
class with many of your own programs and with other programmers. 
For instance, if you save your AthleteList class to a file 
called athletelist. py, you can import the into your code 
using this line of code: 

from athletelist import AthleteList 

then use the class as if it was defined in your current program. And, 
of course, if you create a really useful class, pop it into its own 
module and upload it to PyPI for the whole world to share. 


you are here ► 


209 





test drive 


Lee s fastest times are: [ 2 
Jones f s fastest times are;[ 
McManus r s fastest times are ： 
Sweeney F s fastest times ares 


»> 

James 

Julie 

Mikey 

Sarah 

»> I 




RESTART 


■mot 


Python Shell 


0 

▲ 




Tqst DriVQ 


One last run of your program should confirm that it’s working to specification now. Give it a go in 
IDLE to confirm. 


^ ^ ^ 


coach6‘py - /Users/barryp/HeadFirstPython/chapter6 / coadi6,py 


def sanitise) timestring)! 
if F - F in time_stringi 
splitter f - 1 
elif F i p in time_stringi 
splitter - r T' 
else: 

return (time_string) 

(mins, secs) = time_string.split(splitter) 
return (mins + 1 . ' +^secs) 


class AthleteList ( list ) 


a dob=None, a times- [ ]) 


def _ init_ (self, a_name 
list. ~init j [ ]丁 
self.name a _name 

self-dob = adob 
self.extend(a_times) 

def top3 (self Ji 

return) sorted(set ( [ sanitize)t) for t in self])) [ 0i3]) 

def getcoach data (filename) : 
tryT 

with open (filename) as £i 
data = £.readline() 
tempi = data.strip)).split) 1 f 1 ) 

return( AthleteList(tempi.pop(0) # tempi.pop(0) f tempi) 
except lOError as ioerr: 

print ( 1 File error t 1 + str( ioerr)} 
return (None) 


) 


]ames 
julie 
mikey 
sarah 


get coach data ( 1 james2,txt 1 ) 
get coach data ( 1 julie2,txt 1 ) 
get coach data ( 1 mikey2,txt 1 ) 
get~coach^data ( ' sarah2,tKt 1 ) 


■int (james■name + 
■int (j ulie.name + 
■int (mikey.name + 
■int (sarah.name + 


r s fastest times are 
1 s fastest times are 
f s fastest times are 
' s fastest times are 


+ s tr (j ames,top3())) 
+ str (julie.top3())} 
+ str (mikey.top3()}) 
+ str (sarah.top3()J) 


0 ^ 




>uv- Chiivc 
how 

plrodu^cs the 
output the 

乙 od 匕 h w^hts. 


/ 




Ln: 306 


Cot: 4 


A 


J 9 

1 5 

2 * 
2 2 


F F 

-B 2 
3 2 

2 2 


2 


p p 


f 3 

r 2 
6 • 
12 


3 2 
» » 

2 2 


2 f p 
p f 2 B 
p 2 1 
f 1 * * 
r 12 2 
i * f f 
TJ rL 
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custom data objects 


Coach Kelly is impressed 



By basing your class on built-in functionality, you’ve leveraged the power of 
Python’s data structures while providing the custom solution your application 
needs. 

You’ve engineered a much more maintainable solution to Coach Kelly’s data 
processing needs. 

Good job! 
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python toolbox 



Your Pythow Toolbox 

You’ve got Chapter 6 under your 
belt and you’ve added some key 
Python techiques to your toolbox. 


^ 他 〆 oUk 
/VaV/- H \ c 岣冰 c 


Mo\rc Py-thoh Lihgo 

參 se ^ J， - 5 method a^ur^ehi 

alwa y s ^-Pcirs io ihe duvvcht 
。込必 t ihs-^hde. 
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BULLET POINTS 


■ Create a empty dictionary using the 
diet () factory function or using {}. 

■ To access the value associated with 
the key Name in a dictionary called 
person, use the familiar square bracket 
notation ： person [ ' Name ']. 


■ Like list and set, a Python’s dictionary 
dynamically grows as new data is added 
to the data structure. 


■ Populate a dictionary as you go: 

new_d = { } or new—d = diet () 

and then 

d['Name'] = 'Eric Idle' 

or do the same thing all in the one go: 

new_d = {'Name' : 'Eric 

Idle'} 

■ The class keyword lets you define a 
class. 

■ Class methods (your code) are defined in 
much the same way as functions, that is, 
with the def keyword. 

■ Class attributes (your data) are just like 
variables that exist within object instances. 

■ The — init — () method can be 
defined within a class to initialize object 
instances. 

■ Every method defined in a class must 
provide self as its first argument. 

■ Every attribute in a class must be prefixed 
with self, in order to associate it data 
with its instance. 

■ Classes can be built from scratch or can 
inherit from Python’s built-in classes or 
from other custom classes. 

■ Classes can be put into a Python module 
and uploaded to PyPI. 












7 Web development 



Sooner or later, you’ll want to share your app with lots of people. 

You have many options for doing this. Pop your code on PyPI, send out lots of emails, put 
your code on a CD or USB, or simply install your app manually on the computers of those 
people who need it. Sounds like a lot of work...not to mention boring. Also, what happens 
when you produce the next best version of your code? What happens then? How do you 
manage the update? Let’s face it: it’s such a pain that you’ll think up really creative excuses 
not to. Luckily, you don’t have to do any of this: just create a webapp instead. And, as this 
chapter demonstrates, using Python for web development is a breeze. 


Putting it all together ♦ 


This Web thing will 
never catch on...especially 
now that I have my trusty 
Underwood to keep me 
company... 遍 


this is a new chapter 
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caring is sharing 


If s good to share 


0 


The coach showed us your program 
running on his laptop...any chance me and my 
friends could also get access to our list of 
times? rd love to show them to my dad... 



Coat\\ Geliys 


You're a victim of your own success. 

The new requests come flooding in right after Coach Kelly starts showing 
off your latest program. It appears that everyone wants access to the coach’s 
data! 

The thing is: what’s the M best way” to do this? 
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web development 


You caw put your program on the Web 



A "webapp" is what you want. 

If you develop your program as a Web-based application (or webapp ，for short), 
your program is: 

• Available to everyone who can get to your website 

• In one place on your web server 

• Easy to upate as new functionality is needed 


But...how do webapps actually work? 
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anatomy of a web request 


\^o 


Up Cl^se - 

No matter what you do on the Web, it’s all about requests and responses. A web request is sent 
from a web browser to a web server as the result of some user interaction. On the web server, a 
web response (or reply) is formulated and sent back to the web browser. The entire process can 
be summarized in five steps. 


Step 1 : Your user enters 
a web address, selects 
a hyperlink, or clicks a 
button in her chosen 
web browser. 



Step 2: The web 
browser converts 
the user^ action 
into a web request 
and sends it to a 
server over the 
Internet. 


The Internet 


Were to^ cs 
nest- 







V/ 


Hey, hello there...whafs this? 

A web request just for me? How 
nice... 


Pecidmg what to do next 


Step 3: The web server 
receives the web request 
and has to decide what 
to do next. 


Web 

Server 


One of two things happen at this point. If the web request 
is for static content — such as an HTML file, image, or 
anything else stored on the web server’s hard disk —— the web 
server locates the resource and returns it to the web browser as 

a web response. 

If the request is for dynamic content — that is, content that 
must be generated — the web server runs a program to produce 

the web response. 
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web development 


Step 4: The web server 
processes the web 
request, creating a web 
response, which is sent 
back over the Internet 
to the waiting web 
browser. 



Web 

Server 


o 


The (potentially) many substeps of step 4 

In practice, step 4 can involve multiple sub steps, depending 
on what the web server has to do to produce the response. 
Obviously, if all the server has to do is locate static content 
and sent it back to the browser, the substeps aren’t too 
taxing, because it’s all just file I/O. 

However, when dynamic content must be generated, the sub¬ 
steps involve the web server locating the program to execute, 
executing the located program, and then capturing the output 
from the program as the web response...which is then sent 
back to the waiting web browser. 

This dynamic content generation process has been 
standardized since the early days of the Web and is known 

as the Common Gateway Interface (CGI). Programs 
that conform to the standard are often referred to as CGI 
scripts. 


Here you go...a web 
response generated just for 
you. Enjoy! 


^T CS ' 


The Internet 



Step 5: The web 
browser receives the 
web response and 
displays it on your 
user's screen. 


you are here ► 


217 









webapp requirements 


What does your webapp need to do? 

Let’s take a moment to consider what you want your webapp to look like 
and how it should behave on your user’s web browser. You can then use this 
information to help you specify what your webapp needs to do. 


I guess I need a nice, 
friendly home page to 
kick things off, eh? 


0 


o 
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web development 


^ Sharpen your pencil 



There’s nothing like grabbing your pencil and a few blank paper 
napkins to quickly sketch a simple web design. You probably 
need three web pages: a "welcome” page, a "select an athlete" 
page, and a "display times" page. Go ahead and draw out a rough 
design on the napkins on this page, and don’t forget to draw any 
linkages between the pages (where it makes sense). 
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back-of-the-napkin sketch 

- i^arpen your pencil 
、、 Solution 


The home pdae 
displays a -fHchdly 

0 V" 3 phul 3 hd d lihk "fco 
*thc web dpp. 


There’s nothing like grabbing your pencil and a few blank paper 
napkins to quickly sketch a simple web design. You probably 
need three web pages: a "welcome" page, a "select an athlete” 
page, and a "display times” page. You were to draw out a rough 
design on the napkins. You were to draw any linkages between 
the pages (where it made sense). 








CWtV ors ^ ^ 

a 仏 a 七 d-.s ? lavs a l.st o-f all^c 

JatWs abides. CWcM ^ allele s 

vad'io a^d £c,c6t 

*bo see data. 


J 


^clcdi 


get 7<>u oy\ *tV>c -tv-a^k! 



^ 3ihlcic ^ ihis lisi ^ 

^ehrmCS 

Julie 
^likcy 


赠 k wi-th ： 








TWi 叫 data ^ SavaW 


2J6 

t.t\ 

rxi 




Select 
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web development 


Pesigw your webapp with MVC 

Now that you have an idea of the pages your webapp needs to provide, your 
next question should be: what’s the best way to build this thing? 

Ask 10 web developers that question and you’ll get 10 different answers; the 
answer often depends on whom you ask. 

Despite this, the general consensus is that great webapps conform to the 
Model- View-Controller pattern, which helps you segment your webapp ? s code 
into easily manageable functional chunks (or components').. 




The Model 

The code to store (and sometimes process) your webapp’s data 



The View 

The code to format and display your webapp’s user interface(s) 



The Controller 

The code to glue your webapp together and provide its business logic 


By following the MVC pattern, you build your webapp in such as way as to 
enable your webapp to grow as new requirements dictate. You also open up the 
possibility of splitting the workload among a number of people, one for each 
component. 


Let’s build each of the MVC components for your webapp. 
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build a model 


Model your data 

Your web server needs to store a single copy of your data, which in this case is 
Coach Kelly’s timing values (which start out in his text files). 

When your webapp starts, the data in the text files needs to be converted 
to AthleteList object instances, stored within a dictionary (indexed by 
athlete name), and then saved as a pickle file. Let’s put this functionality in a 
new function called put—to—store () • 

While your webapp runs, the data in the pickle needs to be available to your 
webapp as a dictionary. Let’s put this functionality in another new function 
called get from store (). 



Whew your webapp starts: While your webapp runs: 





The 
put_to—store 。 
function 





The sihglc pickle with 
allihe daia sWcd 
… a di£'tiohdv n y 



TV sm^lc ㈣ lc 
all J 七 ^ 
toatWs da*ta / 

d'\chov\^ 


The 

get_from_store() 

function 


{’ Sarah* : 
1 James 1 : 
1 Julie 1 : 
▼Mikey': 


AthleteList... 
AthleteList... 
AthleteList... 
AthleteList... 
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^>u y\ccd todc 
V^cvc *to 

七 d'lttio^Y Wrth 
七 V>c ds*t3 *f \row 七 he 
^ilcs. 


Here is the outline for a new module called athletemodel .py, which provides the 
functionality described on the previous page. Some of the code is already provided for you. Your 
job is to provide the rest of the code to the put—to_store () and get_from_store () 
functions. Don’t forget to protect any file I/O calls. 

import pickle 

from athletelist import AthleteList 
def get_coach_data(filename) : 

# Not shown here as it has not changed since the last chapter. 


def put_to_store(files 一 list): 
all athletes = { } 


^ is is taWcd wi-th a 

list -filchdr^cs as its sole 
dv-gumcht 


doh’t -Povgci 
io save ihc 
duitiohavy -to a 
pkklc ^hd 
ro\r f ile I/O c^yoY's). 


return(all_athletes) 

def get—from_store(): 
all athletes = {} 



^o{\\ 心灼已七|。於 
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model module 




BceRcvSe 
SotiiivOH 


Here is the outline for a new module called athletemodel. py, which provides the 
functionality described on the previous page. Some of the code is already provided for you. Your 
job was to provide the rest of the code to the put_to_store () and get_from_store () 
functions. You were not to forget to protect any file I/O calls. 

import pickle 

from athletelist import AthleteList 


def get_coach_data(filename) : 

# Not shown here as it has not changed since the last chapter. 


def put_to_store(files—list): 
all athletes = {} 


Take tacM Ale, 
m-bo / 七 cUs 七 

ob\ct*b \Y\s{^Y\Ct, ay\d *^■ 

add abides data 


-for cadh^jfilc *files 」 is*t: 

.aide's hdme is 

uscd ^ M k C y w ih 

.di 匕 "tiohavy. The ；c 

all_a 嶽 es/ ^Uaw ：! 二 ^ ^ - i hc AihleicUsi ob\cd 

. 


a*th =■ i Ic) 


iry ： 


Save "the Ch*ti\rc 

di 匕 tiohav-y o*f — 

AihlctcLis^s 
to a pickle. 


y/i*th opcr\( 1 a*thlc*tcs.pidklc ， , 'wbO as 
pidkle dui 叶 (all 一 a*tlvf) 


e%dep 七 lOBrror as ioevr: 

error (pu 七一 ar\d_s*to 代 )： ’ + s*br(ioevr)) 



/W dov^i 七 
a bryt^i -to 
pv 。 七 efi •七 Y ou，r $ 
I/O todc- 


return(all—athletes) 

def get—from_store(): 
all athletes = {} 


⑼七代 ㈣ 1 c m-to 
i\\c dk 七咖 

!AA>a 七 tould fee 


brf 


wi*th opch( 1 a*thlc*tcs.pidklc > , VbO as 
all 一二 pidde.load(a*tlvf) 


cas\cv- 


? 


|f)&rro\r as ioevr: 
p\rm 七 ('pile error (yt 」 (Vom_s*tovr): ’ + s*tr(iocr\r)) 



^am...doy\ *b 
-fov-yt Y©u\r 
br ^/C 依 ? 七 . 


return(all athletes) 
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f V An IDLE Session 



Let’s test your code to ensure that it is working to specification. Type your code into an IDLE edit window and save 
your code into a folder that also includes the coach’s text files. Press F5 to import your code to the IDLE shell, and 
then use the dir () command to confirm that the import has been successful: 

»> dir () 


['AthleteList ', ' builtins ', ' doc ', ' name ', ' package ', 'get coach data’, 

get from store', 'pickle ', 'put to store'] 


Create a list of files to work with, and then call the put_to_s tore () function to take the data in the list of files 
and turn them into a dictionary stored in a pickle: 


»> the_files = ['sarah.txt', 'james.txt', 'mikey.txt ', 'julie.txt'] 
»> data = put_to_store (the_files) 

»> data 


fWs all J the 

AtKIc-tcLists. 




{'James Lee': ['2-34' , '3:21\ '2.34\ '2.45' , ' 3.01' , '2:01\ '2:01，， ， 3 :10 ' , '2-22\ '2- 
01\ '2.01' , '2:16'], ' Sarah Sweeney' : [ '2:58\ '2.58 、 '2:39\ '2-25\ '2-55 、 '2:54 、 '2.18\ 
▼2:55 、 '2:55 、， 2:22\ ， 2-21 、 '2.22，], ' Julie Jones' : ['2.59 、 '2:11' r '2:23 、 '3- 

10' , '2-23' , '3:10\ ， 3.21\ '3-21' , '3.01\ ， 3.02\ '2:59，], 'Mikey McManus' : ['2:22\ '3.01\ 

▼3:01 ，， '3.02' , '3:02\ ' 3.02' , '3:22\ ， 2.49\ '2:38' , '2:40' , ， 2.22\ '2-31' ] } 


At this point, the athletes . pickle file should appear in the same folder as your code and text files. Recall 
that this file is a binary file, so trying to view it in IDLE or in your editor is not going to make much sense. To access 
the data, use the dictionary returned by the put to store () or get from store () functions. 


Use the existing data in the data dictionary to display each athlete's name and date of birth: 


»> for each athlete in data : 


print(data[each athlete].name + 

James Lee 2002-3-14 
Sarah Sweeney 2002-6-17 
Julie Jones 2002-8-17 
Mikey McManus 2002-2-24 



+ data[each athlete].dob) 

Bv aacss ㈣ 从 c a^d dob 

a 4^ 如 , a 七如 …七 。七 

七 k mdtUsi data- 


Use the get_f rom_store () function to load the pickled data into another dictionary, then confirm that the 
results are as expected by repeating the code to display each athlete’s name and date of birth: 


»> data_copy = get_f rom_store () 

»> for each_athlete in data_copy : 

print(data_copy[each_athlete].name + ' ' + data_copy[each_athlete].dob) 


James Lee 2002-3-14 
Sarah Sweeney 2002-6-17 / 
Julie Jones 2002-8-17 
Mikey McManus 2002-2-24/ 


The daia ih -the ircWhcd ckti 0h 狀 y 

■s as expend, the as 

that P^du^d by s ^ e Q 
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interface view 


View your interface 

With your model code written and working, it’s time to look at your view code, 
which creates your webapp’s user interface (UI). 


On the Web, UIs are created with HTML, the Web’s markup technology. If 
you are new to HTML, it is worth taking some time to become familiar with 
this critical web development technology. There’s lots of material on the Web 
and more than a few good books out there. 






This is -the book that wc 
-fov 'ui 匕 kly 

gc-ttmg up -to speed with 

nT/VJL...ho't wcVc 

biased oir ahy-thihg. © J. 


Hey, we hear you are getting into 
web development? We have a small 
module that we put together that might help 
you generate HTML It's a little rough, but it 
works, you’re more than welcome to use it for 
your projects, if you like. 


(Mosi 0 () -the Head Fivst 

Code Review 



YATE: Yet Another Template Engine 



Your friends over at the Head First Code Review Team heard you’re planning 
to write some code to generate HTML for your webapp’s UI. They’ve sent 
over some code that they swear will make your life easier. It’s a small library 
of HTML-generating helper functions called yate. The code was produced 
quickly and was originally designed to be “throw away,” so the team has 
provided it as is. It’s somewhat raw, but it should be OK. 
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from string import Template 

def start_response(resp="text/html") : 

return('Content-type : ' + resp + '\n\n') 

def include—header(the—title): 

with open('templates/header.html') as headf 
head_text = headf.read() 
header = Template(head_text) 
return(header.substitute(title=the_title)) 

def include—footer(the_links): 

with open('templates/footer.html') as footf 
foot—text = footf.read() 
link—string ='' 
for key in the—links: 

link—string += '<a href="' + the_links[key] + '' + key + '</a>&nbsp;&nbsp;Snbsp;Snbsp; 
footer = Template(foot—text) 

return(footer.substitute(links=link 一 string)) 

def start—form(the—url, form—type=”POST"): 

return('<form action^"' + the—url + '" method^"' + form—type + ') 

def end 一 form(submit—msg="Submit"): 

return('<p></p><input type=submit value="' + submit—msg + 

def radio 一 button(rb—name, rb—value): 

return('〈input type="radio" name="' + rb_name + 

'"value="' + rb—value + '"> ' + rb 一 value + '<br / >') 

def u 一 list(items): 

u—string = '<ul>' 
for item in items : 

u—string += '<li>' + item + '</li>' 
u 一 string += '</ul>' 
return(u—string) 

def header(header—text, header—level=2): 

return('<h' + str(header_level) + '>' + header 一 text + 

'</h' + str(header 一 level) + '>') 

def para(para_text) : 

return('<p>' + para—text + '</p>') 


jodc. 乙 omwhts, cxpla h atiohs ; 
do^umch-ta-tioh, o\r ahy-thihg/ 
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template engine code 



ExeRciSe 


Let’s get to know the yate code before proceeding with the rest of this chapter. For each chunk 
of code presented, provide a written description of what you think it does in the spaces provided: 


Take 3 wowt-- , 

U—7-^ 

module m 

set- 




from string import Template 



you^* 

ih 

the spa^s. 




def start_response(resp= M text/html M ) : 


Oy\c has 
bcch dohe 


aliready _ 
-fov- you. 


return('Content-type : ▼ + resp + '\n\n') 

This -fuhd*tior\ *bdkes d s'm^lc (oJ>*tior\al) 3s i*ts a\rO|umCh*t dhd uses it to 

d\rca*te a C^l u Cor\*tcr\*t-*typc ：w l*me, wi*th u *tc%*t/lvti^l w as -the default 


def include header(the—title): 

with open('templates/header.html') as headf : 

head_text = headf.read() 
header = Template(head_text) 
return(header.substitute(title=the title)) 


def include footer(the_links) : 

with open('templates/footer.html') as footf: 

foot—text = footf.read() 
link_string ='' 
for key in the—links: 

link_string += '<a href= M ' + the 一 links[key] + ' M >' + key + 

'</a>&nbsp;&nbsp;&nbsp;&nbsp;' 

footer = Template(foot—text) 

return(footer.substitute(links=link_string)) 
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def start 一 form(the url, form_type= M POST M ) : 

return('<form action= M ' + the url + ,n method= M ' + form_type + ' M >') 


def end—form(submit_msg= n Submit n ): 

return ( ' <p></p><input type=submit value= M ' + submit_msg + ' M x/form> ') 


def radio 一 button(rb name, rb—value): 

return ('〈input type= M radio M name= M ' + rb name + 

' M value= M ' + rb value + ' M > ' + rb value + '<br / >') 


def u_list(items) : 

u 一 string = '<ul>' 
for item in items : 

u 一 string += '<li>' + item + '</li> 
u—string += '</ul>' 
return(u—string) 


def header(header 一 text, header 一 level=2): 

return ('<h' + str(header level) + '>' + header 一 text + 
'</h' + str(header level) + '>') 


def para(para_text) : 

return ( '<p>' + para—text + '</p>') 
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template engine described 



loHf ExeRciSe - 

^LSoLytloH 

Let’s get to know the yate code before proceeding with the rest of this chapter. For each chunk 
of code presented, you were to provide a written description of what you think it does: 

from string import Template 

|mpo\rt w 7cmpla*tc w dlass -from *thc sia^dardi library’s w sbr’mf 
N 七 仏 ^ ^ module. This allows -for simple s-tv'm^-substi-tu-tioh -templates. 

C c ault 

def start 一 response(resp= n text/html n ): 

return('Content-type : ' + resp + '\n\n') 

This -fu^dtioh -bakes a sih^lc (op*tiohal) as i*ts av-^umer\*t dr\d uses it to 

d\rca*tc d C^l “Corrterrt - lme, wi*th as default 

Opcy\ *b^C def include header(the—title): 

-f ile with open('templates/header.html') as headf : 

is 

head—text = headf.read() 

VCSd >*b header = Template (head—text) 

substrtu 七 ^ return (header, substitute (title=the title)) 

—ded ht\t • ^7 —- - 

This lur\d*tioh -bakes a s'm^lc as i*ts av-^umeh*t dhd uses a 七 *the -title -ror 

■the s*ta\rt a HTML pay. The pay i*bcl-f is stored wi*thm a scpava*tc -file 

•m a^d *thc trtle is substituted m as needed. 

卜 the template . 

■Pile (whi 匕 h is 

ii-r-*., 、 def include footer (the links) : 

HT/Head it • — —, 

3hd subs£.*t 七 • 仏 with open (' templates/footer. html' ) as footf: 

Provided di^iohavy foot text = footf.readO 

WT/WL lihks i h link_string ='' 

the lihks’ \ ) for key in the links : 丁 i • i , • . • 

— / his looks a little 

link—string += ' <a href= M ' + the—links [key] + ' M >' + key + j i i .»； 

'</a>&nbsp; &nbsp; &nbsp; &nbsp; ' ii-taa! ' ? 

r^- nT/Wi- hcldk -rov 

, footer = Template (foot text) - * C ... 

Tum 栋 c J — Wdmg spates 

d.^t. 3^ o-f ^ return (footer. substitute (links=link string) ) ih"to d S"tv*ihJ 

I'mks m*to 3 s*brm3, Similav *bo W mdude_headev” -fuhd*tioh, *this oy\c uses its sm^le str'mj as 

3v-gumch*t to dv-eatc cy\A o4 - a HTML page. The pay itscl-f is stored 
七 he -template- y/i*th*m a separate -file *m w *templa*tes/*foo*ter.lvb^l' ar\d *the av^umerrt is used 

*bo dyy\amiddlly dvca-tc a srt o-f HTML l*mk *t^s. Based oy\ how -they arc used, 
i*t looks like ar^umch*t heeds -to be a did-tiohary. 
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web development 


This is typically ci-thcir 

PO£r 

def start form(the url , form type= M POST") : 

— — — 

return('<form action= M ' + the url + ,n method= M ' + form_type + ' M >') 

This -fuhd*tioh returns ttTAIL -for 七 he sta\rt 3 -form lets 七 he duller 

spedi-fy *thc URL -to se^d *thc -formas da*bd b>, Bs well as -the method *to use. 

def end—form(submit_msg= n Submit ”）： 

return ( ' <p></p><input type=submit value= M ' + submit_msg + ' M x/f orm> ') 

This -fuhdtioh vc*tu\rhs ttTAIL markup, y/hidh *tcvr«*ma*tcs -form y/hile 

allow'm^ dal lev *to dustomiz^ *thc o-f ^form’s “submi*t” button 

def radio—button(rb name , rb_value) : 

return ('〈input type= M radio M name= M ' + rb name + 

,n value= M ' + rb—value + ' M > ' + rb 一 value + '<br />') 

^ivcr\ a radio — button hdme dhd value ； a HTML radio button (whidh is 
■typically mduded y/i*tlVm a HTML -form). htoic ： bo*th argumCh-ts arc required. 

def u 一 list(items): 

u—string = '<ul>' 
for item in items : 

u—string += '<li>' + item + '</li>' 
u—string += '</ul>' 
return(u—string) 

^iveh a lis*t of i*tcms, *this fur^tioh *tu\rhs *the lis*t *m*to d ttTAIL urmumberedl 
list A simple for” loop does all 七 he v/ork, addi^ a L| *bo *thc UL eler^errt 
y/i*th eddh i*tcra*tioh. 


Simple W 匕 〆’ 

loop docs W\t 
•br’itk. 


def header(header 一 text, header 一 level=2): 

return ( '<h' + str(header 一 level) + '>' + header—text + 

'</h' + str(header level) + ▼>▼) 

Cveate a^d re*tu\rh a HTML headier *ta^ HZ, HZ, ay\d so oyO y/i*th level Z 
as -the default.. The 一七 av^umerrt is required. 


def para(para_text) : 

return ( '<p>' + para—text + '</p>') 

Ehdose a paragraph o-f 七以七 （a s-tvm^) *m HTML paragraph *t^s. ^\lmos 七 七 

wo\rth *the e-f-fovt) is i*t? 
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no dumb questions 


t^ereiare no o 

Dumb Questi9ns 


Where are the HTML templates used in the include_ 
header() and include_footer() functions? 

They are included with the yate module’s download. Go 
ahead and grab them from the Head First Python support website, 
and put them into a folder of your choice. 

Why do I need yate at all? Why not include the HTML that I 
need right in the code and generate it with print() as needed? 

You could, but it’s not as flexible as the approach shown 
here. And (speaking from bitter experience) using a collection of 
print () statements to generate HTML works, but it turns your 
code into an unholy mess. 


And you did this because you are using MVC? 

Partly, yes. The reason the MVC pattern is being followed is to 
ensure that the model code is separate from the view code, which 
are both separate from the controller code. No matter the size of the 
project, following MVC can make your life easier 

But surely MVC is overkill for something this small? 

We don’t think so, because you can bet that your webapp will 
grow, and when you need to add more features, the MVC “separation 
of duties” really shines. 




/ 


An IDLE Session 


Let’s get to know the yate module even more. With the code downloaded and tucked away in an easy-to- 
find folder, load the module into IDLE and press F5 to take it for a spin. Let’s start by testing the start_ 
response () function. The CGI standard states that every web response must start with a header line that 
indictes the type of the data included in the request, which start response () lets you control: 


dc-Paul-t C^l ircspohsc header 

plus vaviatiohs oh a -theme. 


»> start_response () 

'Content-type : text/html\n\n' 

»> start—response ( M text/plain ") 

'Content-type : text/plain\n\n' 

»> start—response ( M application/ j son M ) 

'Content-type : application/json\n\n' 

The include_header () function generates the start of a web page and let’s you customizee its title: 

»> include—header ("Welcome to my home on the web!") 

'<html>\n<head>\n<title>Welcome to my home on the web!</title>\n<link type= M text/css M 
rel="stylesheet" href= M / coac h.c ss M / >\n</head>\n<body>\n<hl>Welcome to my home on the web!</ 
hl>\n' 





*bo fee 
fe\rov/scv- 

七 V>c 
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web development 


The include_f ooter () function produces HTML that terminates a web page, providing links (if provided as a 
dictionary). An empty dictionary switches off the inclusion of the linking HTML: 


»> include_footer({'Home' : '/index.html ', 'Select': '/cgi-bin/select.py'}) 

'<p>\n<a href="/index.html M >Home</a>&nbsp;&nbsp;&nbsp;&nbsp;<a href= M / cgi-bin/select. 
py M >Select</a>&nbsp;&nbsp;&nbsp;&nbsp;\n</p>\n</body>\n</html>\n' 


»> include_footer ({}) 

'<p>\n\n</p>\n</body>\n</html>\n' 



\ 


]/\l\i\\ I'mks mtludcd, and 

Wl 七 ViOVA 七 . 


The start_form () and end—form () functions bookend a HTML form, with the parameter (if supplied) 
adjusting the contents of the generated HTML: 



»> start_form( n /cgi-bin/process-athlete • py") 

'<form action= M /cgi-bin/process-athlete.py" method:”POST' 
»> end_form () 

'<pX/pXinput type=submit value= M S\abmit M X/form>' 


扣 3_<^ allows you -to spcdi^y 
七 he hamc of -the pvog^rh oh the 


»> end—form("Click to Confirm Your Order") 

<pX/pXinput type=submit value= M Click to Confirm Your Order"X/form> 


HTML radio buttons are easy to create with the radio button () function: 


»> for fab in [' John' , ' Paul' , 'George ', 

radio button(fab, fab) 


'Ringo'] : 

咖仏。从 k Y ouyr ^vov^rtc? 

W •bV.c list radio 


▼<input 
'<input 
▼<input 
▼ <input 


type= M radio" 
type= M radio" 
type= M radio" 
type= M radio" 


name= M John" value= M John M > John<br />▼ 
name: n Paul" value= M Paul"> PauKbr />' 
name= M George" value= M George M > George<br 
name= M Ringo" value= M Ringo"> Ringo<br /> 




Unordered list are a breeze with the u—list () function: 

u_list(['Life of Brian ' f 'Holy Grail']) 

<ulXli>Life of Brian</liXli>Holy Grail</liX/ul>' 



Agam, ioo easy 0 , you ^ but 

as ^ as y oulr wcb bv-owsc^ is 
乙 oh 匕 evhed. 


The header () function lets you quickly format HTML headings at a selected level (with 2 as the default): 

»> header ("Welcome to my home on the web") 

'<h2>Welcome to my home on the web</h2>' 

»> header ("This is a sub-sub-sub-sub heading" , 5) 

'<h5>This is a sub-sub-sub-sub heading</h5>' 


as c 乎如土 Same aocs W 


Last, but not least, the para () function encloses a chunk of text within HTML paragraph tags: 

»> para ("Was it worth the wait? We hope it was...") 

'<p>Was it worth the wait? We hope it was...</p>' 
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controller code 


Control your code 

Your model code is ready, and you have a good idea of how the yate 
module can help you with your view code. It’s time to glue it all together 
with some controller code. 

First things first: you need to arrange your wedapp’s directory structure to 
help keep things organized. To be honest, anything goes here, although by 
giving it a little thought, you can enhance your ability to extend your webapp 
over time. Here’s one folder structure that Head First Labs recommends. 



You tall 70 UV 
^oldcv you hkc. 



/\ s ^|| as wU — 如 sub^oiacvs, Udo 

^\Co^\to > ， \Co^ s^lc sheets, a^d 扣 H 

，七 心七 neatly ov\t ok the 


else dot^ri 

sub-foldcvs. 



"that you wvi-tc -Pov 
yowr webapp heeds io ^Sidc ih a 
【penally -Poldcv tdWtd w ^i- 



Head on over to the 
Head First Python support 
website, download 
webapp. zip, and 
unpack it to your hard 
disk. 



Lets keef c^oacM's, 
data m a separate 
-folder fey all o\ 

七 k TyJ 以 cs m V^cvc. 





fIFs, P^ S) so o,) ; POP 

^ owh ^oldc^ io help 
keep thihgs ovgahiicd. 



The templates 払 at ” 
tawc Wi*bV^ W\t w y^ c， ?7 

dovmloadUay^。 … 
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web development 


CW lets your web server rim programs 

The Common Gateway Interface (CGI) is an Internet standard that allows for 
a web server to run a server-side program, known as a CGI script. 

Typically, CGI scripts are placed inside a special folder called cgi-bin, so 
that the web server knows where to find them. On some operating systems 
(most notably UNIX-styled systems), CGI scripts must be set to executable 
before the web server can execute them when responding to a web request. 




Move oy \ m 
a little loVb. 


So...to run my webapp, 

I need a web server with 
CGI enabled. 




All webapps need to run on web servers. 

Practically every web server on the planet supports CGI. Whether 
your running Apache, IIS, nginx, Lighttpd, oy any of the others, they 
all support running CGI scripts written in Python. 

But using one of these tools here is overkill. There’s no way the 
coach is going to agree to download, unpack, install, configure, 
and manage one of these industry heavyweights. 

As luck would have it, Python comes with its very own web server, 
included in the http . server library module. Check the 
contents of the webapp . zip download: it comes with a CGI- 
enabled web server called simplehttpd. py. 


/rhpov-t -the http 

sc ^Clr c^i t- 
^odulcs. 

a yori. 


7 — 




from http.server import HTTPServer, CGIHTTPRequestHandler 


Cvca 七 e a 
HTTP scv-vc\r 





w cssay 

sewev 


'youv 


port = 8080 

^httpd = HTTPServer (( ，， ， port), CGIHTTPRequestHandler) 


print("Starting simple 一 httpd on port : 


u 


+ str (httpd. server_j>ort)) 


httpd.serve 一 forever() 
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generate list 


display the list of athletes 

Let’s create a program called generate_list. py which, when executed 
by the web server, dynamically generates a HTML web page that looks 
something like this: 


This is a pavagvaph. 

4 


ov\t v-ad»o 

W 七 "ton eaA 

a*b^lc*bc- 


’七 wouldh "t huirt "to 


add a -title -to this 
web would i-t? 




Sc,C ^ ah 仙士柊 。你 this |is£ 匕 



S^^folh 

o 


O 

Julie 

o 

Alikcy 




h 


/\ 、 uWrt” W 七 


When your user selects an athlete by clicking on her radio button and clicking 
Select, a new web request is sent to the web server. This new web request 
contains data about which radio button was pressed, as well as the name of a CGI 
script to send the form’s data to. 

Recall that all of your CGI scripts need to reside in the cgi-bin folder on 
your web server. With this in mind, let’s make sure your generate_list. py 
CGI script sends its data to another program called: 

cgi-bin/genera te_timing 一 data • py 
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Paa] Puzzjc 

Your job is to take the code from the pool and 
place them into the blank lines in the CGI 
script. You may not use the same line 
^ of code more than once. Your goal is to 
>—make a CGI script that will generate a 
^-u X M HTML page that matches the hand-drawn 

design from the previous page. 

I^ovi the modules that you heed You've 

fvc started athletemodel ^_Already 

七 Wmy 一 ， import yate module lets you y ou ^ 

•foV" Y ou， import glob op 抑 system -fov- a list 4lc hames. 

data files = glob. glob ("data/* . txt") Use Vouv- ?u*b 一 "to 一 

— _ _. i n a A\chor\^s ok athletes 

athletes = athletemodel. put_to_store (data_f iles) ^ ^ G 七 ^ ^ ^ -f dd'td ^lies 

Let’s add a li h k io . 

"the bo"t"torn o-p 

gchcira-tcd HTML . 

page -that -bkes . 

yowr usc\r home. 

print(yate.include 一 footer({"Home" : " / index.html"})) 


Note: each thing from 
the pool can be used 
once! 





for each athlete in athletes : r a thletes [eanh ,, e tes 

— . ，一 。•^ response 0) print ( yate fr ^ 二 ^ lete ] .nam e) 


■data.py ,r j j 

to wor ^ with- 7 ) 

， ° f A thletes^) 


)r int(yate.start 
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cgi script 



puzzjc 

Your job was to take the code from the pool 
and place them into the blank lines in the 
CGI script. You were not to use the same 
line of code more than once. Your goal 
was to make a CGI script that generates a 
HTML page that matches the hand-drawn 
design. 



import athletemodel 
import yate 
import glob 

Siairt gchc\ra-ti h g -the 

data files = glob • glob ( n data/* • txt n ) web pirovidih^ dh 

AUavs s*tav-*t WrtV) a " appvopv-ia-tc tiile. 

7 / , , i. athletes = athletemodel. put to store (data files) 

c 。 如七 - 切 ? c ] -- - 

qi , ’print (yate • start—response ()) 

the ^ print (yate . include_header ( "Coach Kelly ' s List of Athletes" ) ) A 

pv-ovidihj print (yate • start 一 form ( n generate_timing—data • py n ) ) 

"the sevvev— print (yate . para ("Select an athlete from the list to work with :’，）） 

side pvogvam -to . 

lihk -fco. 

for each—athlete in athletes : 

print(yate.radio button("which athlete", athletes[each athlete].name)) 

Strait a vadio- . . - . - .m .r. :•… 

』 . pr ^^ ( ^^ e .： ^ e ‘ 

^J-uU4- C s. Submit butxoh. 

/ ou print(yate.include footer({"Home" : " / index.html M })) 



Cool...3^ 
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web development 



What you need to do next depends on the operating 
system you’re running your web server on. 

t y . r •. f If you are running on Windows, stop reading right now and 
Wcilvil II. proceed to the Test Drive. However, if you are running a Unix- 

based system (such as Linux, Mac OS X， or BSD) you need to 
do two things to prepare your CGI script for execution: 

1. Set the executable bit for your CGI using the chmod +x command. 

2. Add the following line of code to the very top of your program: 

#! /usr/local/bin/python3 




Fvom 70UV Wm'rnal Wmdov/, 

chmod +x generate list 

py set bit- You 

wed do 七 Wis cmh/ oUt- 


Tesr DriVq 


To test drive your CGI script, you need to have a web server up and running. The code to 
simplehttpd. py is included as part of the webapp . zip download. After you unpack the ZIP 
file, open a terminal window in the webapp folder and start your web server: 


File Edit Window Help WebServerOnWindows 


c : \Python31\python.exe simplehttpd.py 
Starting simple httpd on port: 8080 



Wsc this 

° h I^VIhdows-bascd 


: n\s. 


File Edit Window Help WebServerOnUNIX 



$ python3 simple_httpd.py 
Starting simple httpd on port : 8080 


Use *bWis Cow^w\BY\d 


cm 


〒七 c 
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test drive 




Tesr DriVq^ cannuteD - 

With your web server running, let’s load up Coach Kelly’s home page and get things going. You’ve 
started your web server running on port 8080 on your computer, so you need to use the following 
web address in your web browser: http : // localhost : 8080 . 


@ O O 


Welcome to Coach Kelly's Website 


(Khttp:// local hast：e0S0/ 


C] (Q^ Coogls 




PP :::: Apple Yahoo! Google Maps YouTube Wikipedia Popular" 



丁 he doa 匕 h’s home page 
dppcairs ih youv- birowsev. 

called w ihdcx.hUl w 
广 d it is ihdludcd ih -the 
W—p.—’ dowhload. 




W 兮 1 yy 竺 ㈣ 哇 - 

For now, all that youll find here Is my athlete's timing data. Enjoy! 
See you on the track! 


...and you^r >/cfe sevvev 
s^vrny m*to li-fc, 

(*bo sCxttvO ^ 3ir\d 

3 II Y/eb v-c^ucs-bs 七 [a 七’七 

pv-otcsscs. 


A 


TV w *bW ” 
d W V>Y\>cvlmk is 

*^ 0，r 7 ou 

-bo t\\cV 


$ python3 simple—httpd.py 
Starting simple—httpd on port: 8080 

localhost - - [12/Sep/2010 14:30:03] "GET / HTTP/1.1" 200 - — ’ 

localhost - - [12/Sep/2010 14:30:03] "GET /coach.css HTTP/1.1" 200 - 

localhost - - [12/Sep/2010 14:30:03] "GET /images/coach-head.jpg HTTP/1.1" 200 - 

localhost - - [12/Sep/2010 14:30:03] "GET /favicon.ico HTTP/1.1” 200 - 



Help DisplayingHomePage 
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web development 


Sure enough, clicking on the home page’s link runs the generate—list • py program on the web 
server, which displays Coach Kelly’s athletes as a list of radio buttons. 


BOO 


Coach Kelly's List of Athletes 


http://local hostieoSQ/cgi-bin/genierateJist.py 


C Google 


PP :::: Apple Yahoo! Cooglle Maps YouTube Wikipedia Popufar 1 


Coach Kelly's List of Athletes 


Sefect an athfete from the Jiist to work with: 

James Lee 
O Sarah Sweeney 
O Julfe Jones 
O Mikey McManus 

! 5el€ct ] 

Home 



Lookihg good...-the web 

has bcch gehevated 
^\rcd\y... 


...ay^a 70 U\r v/efe sc\rvcv loy 
{\\C v/cfe v-c<\ucs*b -to v-un 

C$1 辦 七 . 



_1 


| File Edit Window Help DisplayingHomePage 

] 


Starting simple—httpd on port: 8080 

localhost - - [12/Sep/2010 14:30:03] "GET / HTTP/1.1" 200 - 

localhost - - [12/Sep/2010 14:30:03] "GET /coach.css HTTP/1.1” 200 - 

localhost - - [12/Sep/2010 14:30:03] "GET /images/coach-head.jpg HTTP/1.1" 200 - 

localhost - - [12/Sep/2010 14:30:03] "GET /favicon.ico HTTP/1.1" 200 - ^ 

localhost - - [12/Sep/2010 14:45:16] "GET /cgi-bin/generate list.py HTTP/1.1" 200 二 


You can click the Home hyperlink to return to the coach’s home page, or 
select an athlete from the list (by clicking on their radio-button), before 
pressing the Select button to continue. 


Select an athlete and press Select. What happens? 
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no such cgi script 


The dreaded 404 error! 

Whoops! Your web server has responded with a “404” error code, which is 
its way of telling you that something was wrong W\\hyour request. The web 
server is in fact telling you that it can’t locate the resource that your web 
browser requested, so it’s telling you \hdlyou made a mistake: 


^ ^ Error response 



Check the web server’s console window to confirm that your attempt to post your 
form’s data to generate_timing_data . py resulted in failure. 

Which isn’t really that surprising seeing asjou have yet to write that code! So.. .things 
aren’t as bad as they first appear. The “404” error is exactly what you would expect 
to be displayed in this situation, so your generate_list. py CGI is working 
fine. What’s needed is the code to the other CGI script. 


If you create the required CGI script, you’ll be back on track. 
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web development 


Fireside Ghats 



Tonight’s talk ： To be CGI or not to be CGI, that is the question. 


A Python Program: 

Listen: you’re really not all that different than me; 
you just work on a web server, whereas I can work 
anywhere. 

Special?!? But you only work on the Web, nowhere 
else. How’s that “special ”？ 


Nonsense! The truth is that you work only on the Web 
and break pretty quickly when used elsewhere. You 
don’t even have control over your own I/O. 


Like [sniggers] generating text in the form of 
HTML? That’s really taxing … 


Oh, get over yourself! You’re a regular program, 
just like me. I can generate HTML, too, I just 
choose not to. 

I guess so … 


guess so. 


A Python CGI Script: 


Yes. I like to think of myself as special. 


Because all the cool stuff works on the Web these 
days and I’m designed, optimized, tailored, and 
engineered for the Web. Because the Web’s a cool 
place, it follows that I must be cool, too. See: special. 


I don’t need control over my input and output. I 
have a friendly web server to take care of that for 
me. My input comes from the web server and my 
output goes to the web server. This arrangement 
allows me to concentrate on the important stuff. 

Smirk all you want; HTML makes the World Wide 
Web go around and I’m a master at generating it 
dynamically ， on demand, and as needed. Without me, 
the Web would be a pretty static place. 


And if you did generate HTML, you’d want it 
displayed somewhere.. .like in a browser? 

And to do that you’d need to rely on the services of 
a friendly web server, right? 

Which would make you a CGI script. So, you’d be 
special, too. Q.E.D. 
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yet another cgi script 


This might be 
as av\ 

Uhoirdcvcd HT/l/IL list 


Put how do you know which athlete is selected? 

When you click on a radio-button and then press the Select button, a new 
web request is sent to the server. The web request identifies the CGI script 
to execute (in this case, that’s generate_timing_data . py), together 
with the form’s data. The web server arranges to send the form’s data to your 
CGI script as its input. Within your code, you can access the form data using 
Python’s cgi module, which is part of the standard library: 
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import cgi 

form—data = cgi.Fieldstorage() 
athlete name = form data[ 1 which athlete’].value 


all ^ 4^ daia 

put it ih a d\cho^y. 


/\ddcss a earned ficdc o( da*ta -fv-om 七 he -Povm s data- 




Create another CW script 


Let’s take a moment to recall what is required from the generate_ 
timing—data • py CGI script. Based on your hand-drawn sketch from 
earlier, your need to generate a new HTML page that contains the top three 
times for the selected athlete: 


TWis looks like a 

HTML ^ 


Its pirobably a O^ood 
•dca -to add a iiilc 
^ io this page. 


TW” data -for SaraW 


2 Je 


Lets ihdude 
"the ahilcic s 
•Pull hdme d h d 
VOb hcvc. 








web development 



Wrbe 七 he todt 
•to vouv y\c>w C^l 
sCrx^i V\cv-c. 'n N ss ^^ 


It’s time to exercise your newly acquired web-coding chops. Grab 
your pencil and write the code for the generate—timing—data • 
py CGI script. It’s not too different from the generate—list • py 
code, so you should be able to reuse a lot of your existing code. 
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revised script 


^ Sharpen your pencil 
、、 Solution 


It’s time to exercise your newly acquired web-coding chops. You 
were to grab your pencil and write the code for the generate_ 
timing—data • py CGI script. It’s not too different from the 
generate—list • py code, so you should be able to reuse a lot of 
your existing code. 


养！ / us\r/lodal/b*m/ 




■This Imc is needed oy\ U^*nc-bascd sys-tems only. 


impovt 631 


七 he 

|'ib\rav-'ics 
modules Y ou ‘ 
m*bcy\d *to use. 


impovt a*We*te^odel 


impor 七 ya*tc 


the daia . 

"the —^ athletes =■ athletemodel.yt 一一 s*boveO 
model. . 


a*Wc 七 e 、 
da-ta a\rc —^ 
vou Y/oV"knr\^ 

4? 

Wothihg 
hcv-c ― 〒 
ov- hcvc. 



<fo\nm_d3*ta 二 ^i.picldStoragcO 

a*thlc*tc r^amc — -form da*ta[’wlVidh a-thlcWJ valuc 



pv-m^yatestar-t^jrespohsef)) 

prm 七 (ya*te.mdude 一 ^elly^s TWnr^ Da*ta ; 0) 
pvm 七 (yate header (” 壯 Wd ” + athlete 一 V0h ： w ^ 

a*thlc*tcsCa*thlc*tc har^e3.dob + 



—ab the 

: Athletes hdme 

ahd DOB. 


TV feo-t-tow of 

七 Wis y / c 1 d 州 €一 
V^ds *t>/o Us. 


prmi(yaie.para( w Thc -top times -for -this arc 1 )) j uv: ^ .ihc .% cc l,s ^ 

pvm 七 (ya*te.u」is 七 (a*We*tes[a*We*te_hame].*top3())) 扣 uir\ov-dcv-cd HTML-- 

prm 七 (Ya*te.mdude__foo*ter({”Home ”： "/mde%.lvbr«r, 

w Selcd*t aho*ther a*thle*tc ,，： ^^chcra-tc^lis-t py^})) 


\ A lihk b^k -to the Previous 
C^l 
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web development 


Tesr DriVq 


Note: 1*(* you av~e oy\ a Uy>"i%-bascdi sys 七 cm, do 灼七 *fov^c*t 
{fi add w chmod +x generate 一 timing 一 data • py *to 

se 七七 he c%cdu*t3blc bi*t- 


Your web server should still be running from earlier. If it isn’t, start it again. In your web browser, 
return to the coach’s home page, then select the hyperlink to display the list of athletes, select Sarah, 
and then press the button. 


0 O O 


Coach Kelly's Timing Data 


http : // localhost:80S0/cgi-bin/ge n erate_ti m i n g _data. <5 \J,0^ Google 




TWis all 

looks 0 ^- 


PP :::: Apple Yahoo! Coogile Maps YoyTube Wikipedia Popufar 1 



Coach 哮 IJ.Y_!"Tirnjri 9 |Data 

Athlete: Sarah Sweeney, DOB: 2002-6-17 


Ah, phooey/ 
Somrthihg’s hot 
—te Hght hcvc. 

■top thv-cc times? 


The top times for thfs athfete are ： 



71 


Poes {\\c 
y/cIo scv-vcv- s 

七 I 。扒 

•bell you 


File Edit Window Help HoustonWeHaveAProblem 


$ python3 simple—httpd.py 
Starting simple—httpd on port: 8080 

localhost - - [12/Sep/2010 14:30:03] "GET / HTTP/1.1" 200 - 

localhost - - [12/Sep/2010 14:30:03] "GET /coach.css HTTP/1.1” 200 - 

localhost - - [12/Sep/2010 14:30:03] "GET /images/coach-head.jpg HTTP/1.1” 200 - 

localhost - - [12/Sep/2010 14:30:03] "GET /favicon.ico HTTP/1.1" 200 - 

localhost - - [12/Sep/2010 14:45:16] "GET /cgi-bin/generate_list.py HTTP/1.1" 200 - 

localhost - - [12/Sep/2010 16:12:27] ''GET /cgi-bin/generate_list.py HTTP/1.1” 200 - 

localhost - - [12/Sep/2010 16:12:29] ''POST /cgi-bin/generate_timing_data.py HTTP/1.1 〃 200 - 

Traceback (most recent call last) : 

File 、 '/Users/barryp/HeadFirstPython/chapter7/cgi-bin/generate_timing_data.py", line 21, in <module> 
print(yate.u_list(athletes[athlete_name].top3())) 

TypeError : 'list/ object is not callable 

localhost - - [12/Sep/2010 16:12:29] CGI script exit status 0x100 




Your CGI has suffered from a TypeError exception, but other than looking at the web 
server’s logging screen, it’s not clear on the web browser screen that anything has gone wrong. 

What do you think is the problem here? Take a moment 
to study the error message before flipping the page. 
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track down cgi errors 


Enable C&l tracking to help with errors 


The CGI standard dictates that any output generated by a server-side 
program (your CGI script) should be captured by the web server and sent 
to the waiting web browser. Specifically, anything sent to STDOUT (standard 
output) is captured. 

When your CGI script raises an exception, Python arranges for the error 
message to display on ST DERR (standard error). The CGI mechanism is 
programmed to ignore this output because all it wants is the CGI script’s 
standard output. 



■ _ 0 but that’s the way the CGI cookie 



This behavior is fine when the webapp is deployed, but not when it’s being 
developed. Wouldn’t it be useful to see the details of the exception in the 
browser window, as opposed to constantly having to jump to the web server’s 
logging screen? 

Well.. .guess what? Python’s standard library comes with a CGI tracking 
module (called cgitb) that, when enabled, arranges for detailed error 
messages to appear in your web browser. These messages can help you work 
out where your CGI has gone wrong. When you’ve fixed the error and your 
CGI is working well, simply switch off CGI tracking: 


import cgitb 
cgitb.enable() 



tc^hholoav. 


Add these two lihes hedv* -the 
youm C^l sd\r',pis io 

[able Py-thoh S C6il 
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Tesr DriVq 


Add the two CGI tracking lines of code near the top of your generate—timing—data • py CGI 
script. Press the Back button on your web browser and press the Select button again. Let’s see what 

临 J Look at all happens this time, 
of 七 Wis dc*t3»l- 


矜 no 


Coachi Kelly's Timing Data 


http:// local host ： e 0 S 0 /cgi-bin/ge nerateji ming_d ata.py 


PQ iiii Apple Yahoo! Coogle Maps YouTube Wikipedia. Popular 1 

Coach Kelly's Timing Data 



Athlete: Sarah Sweeney, DOB: 2002-6-17 


The top times for this athlete are: 


TypeError 


Pythc 

/Lifarary/Frameworks/Python .framework/Versio ns/3,1 /Resou re^s/Python .ap p/Conte nls/MaoOS 

Sun Sep 12 20:13^ 


A probtem occurred in a Python script. Here is the sequence of function calls reading up to the error, m the order they 
occurred. 


/Users/barryp/HeadFirstPython/chapter7/cgi-bin/generate_timing_data.py in () 


13 


athletes[ athlete name] .dob + n * 11 ) J 


20 print{yate.para{"The top times for this athlete are:™1) 




21 print^yate .u llst't athletes! athlete name] . top3 -())) 


2 2 print {yate . include_footer ( { ^Bome n t 111 /index. html 11 , 


2 3 


"Select another athlete" : n generatY_li3t .py" 1 *)) 


tuiitin print = < built-in function print>, yate = < module \ ate f from 7U s e rs/ba rn\ p/ Head FI rstPy th o n/ ch a pte r7/ eg \ - 
bir/yate.py K >, yate.u_llst = <functSon u—list 》， athletes = {lames Lee h : ['2-34 h , ' ： |:21^ '2.34^ *2.45\ '3.01^ '2:01' f 
f 3:10V '2-22\ f 2-0lV r 2.0lV Y 2:W] f Julie Jones.: [*2.59\ '2.11\ *2:11' f h 2:23 h ,b-10 t , *2-23\ Y 3\10\ '3.21% '3-21\ 
K 3.01 h ir *3.02\ .2:59.], >likey McManus ，： 12:22\ *3:01\ '3.02\ *3:02\ '3.02' f f 3 22' f *2.49* f 2:40 f f u 2.22\ l 2 

31 h ], 卜 Sarah Sweeney\ ，叫乂，帥， ， -? ^2:54\ *2. IS 1 , *2:55\ h 2:=/5 h , '2:22\ l 2-21 、 2.2T]} f 

athliete^name = 'Sarah SweeneyV^topS undefine 


TypeError ： list' object is not callable 

□rgs = 「 list* object is not callable') 

with_traceback = <built-in method with_tracebEick of TypeError objects 




Notice that the CGI tracking module tries to identify 
exactly where the problem with your code lies. 



this? is 

Uhdc-Pi hed?/? 
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small fix, big difference 


A small change can make all the difference 

The CGI tracking output indicates an error with the use of the top3 () method 
from the AthleteList code. 

A quick review of the code to the AthleteList class uncovers the source of the 
error: the top3 () method has been redesignated as a class property. 



Th ' s dcdo ^"toir allows you io aucss the da-b 

= w 丄心 J 


(@proper^^ 
def top3(self) : 

return(sorted(set([self.sanitize(t) for t in self]))[0:3]) 


The use of the @property decorator allows the top3 () method to appear 
like an attribute to users of the class. So, instead of calling the top3 () 
method like this: 



A wthod 匕 all 
always heeds -the 
pav-chthcscs... 


print(yate.u 一 list(athletes[athlete name].top3(j)) 




Treat the top3 () method as if it was another class attribute, and call it like 
this: 



If s a small change, but if s aw important one 

When a change is made to the way a class is used, you need to be careful to 
consider what impact the change has on existing programs, both yours and 
those written by others. 

At the moment, you are the only one using the AthleteList class, so it’s 
not a big deal to fix this. But imagine if thousands of programmers were 
using and relying on your code … 


..unless i\\t is dedaved 

•bo fee a” y/WA 

tasc ^av-c^escs avc NOT 


Let’s fix your CGI script and try again. 
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Tqst DriVQ 


Make the small edit to your code to remove the brackets from the call to the top3 () method, press 
your web browser’s Back button, and press the Select button one last time. 


a o 


Coach Kelly's Timing Data 


(Khttp;//localhost:B0S0/cgi-bin/generate_timingi_d.ata. C ] (Q, t Google 


QP :::: Apple Yahoo! Google Maps YouTube Wikipedia PopularT 


Coach Kelly's Tinning Data 

Athlete: Sarah Sweeney, DOB: 2002-6-17 


The top times for this athlete are: 


2.18 


^/\\00 V^ooj "TVlS 
-time selected • 2,21 

athletes da*ta (• 

2.22 

ov\ screen. 

|v(iC.c, cV>? 


Wow -that you've 
solved that 

problem, be suire 

io switch o*ff 
C^l tv^kihA. 


Home 5elect another athlete 


A 


D 


thereicir 

)umb 


e no o 

Questi 9 ns 


What happens if the coach recruits new athletes? 

All Coach Kelly needs do is create a new text file similar to the 
others, and your webapp handles the rest by dynamically including 
the new athlete the next time your webapp runs, which occurs when 
someone clicks on the home page’s “timing data” hyperlink. 


Shouldn’t the server’s data be in a database as opposed 
to a pickle? Surely that would be better, right? 

In this case, it’s probably overkill to use a database, but it might 
be worth considering sometime in the future. 
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successful webapp 


Your webapp、a hit! 



This is great! Now I can 
share my data with the kids, 
and they can access their 
times without bugging me... 



Hey, this is super cool 
and the coach is right... 
if we train hard, we can 
improve on these times! 


By moving your program to the Web, you’ve made it a no-brainer for Coach 
Kelly to share his data with not only his athletes, but with anyone else that 
needs to access his data. 

By conforming to the MVC pattern and using CGI, you’ve built a webapp in 
such a way that it’s easy to extend as new requirements are identified. 


Congratulations! You’re a web developer. 
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web development 



Your Pythow Toolbox 

You’ve got Chapter 7 under your 
belt and you’ve added some key 
Python techiques to your toolbox. 


Pyihoh Lih^ 0 

lch ， 


^ dass 


fe\> U — 0 

，，- a ”如咖一 

he Wcfc- . 

，，一 servt *tV>C ^ 

^ u >mA 「 y. c osor\SC 

W W °^ ? 

{jo a ^ 代 fst 

u C 61 ” - *tV Co’ 0 ” ^ 

ui 弋加二:一 

,» avv />4-^cv r\3wc ^ 3 
- ^ othC 

str , t r^At 




BULLET POINTS 


■ The Model-View-Controller pattern lets 
you design and build a webapp in a 
maintainable way. 

The model stores your webapp’s data. 

The view displays your webapp’s user 
interface. 

The controller glues everything together 
with programmed logic. 

The standard library string module 
includes a class called Template, 
which supports simple string substitutions. 

The standard library http, server 
module can be used to build a simple web 
server in Python. 

The standard library cgi module 
provides support for writing CGI scripts. 

The standard library glob module is 
great for working with lists of filenames. 

Set the executable bit with the chmod 
+x command on Linux and Mac OS X. 

The standard library cgitb module, 
when enabled, lets you see CGI coding 
errors within your browser. 

Use cgitb. enable () to switch on 
CGI tracking in your CGI code. 

Use cgi . FieldStorage () to 

access data sent to a web server as part 
of a web request; the data arrives as a 
Python dictionary. 


CHAPTER 7 
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8 mobile app development 




參 Small devices + 



This had better be a 
smartphone running 
Honeycomb or Mr. Smooth 
is history! 


Putting your data on the Web opens up all types of possibilities. 

Not only can anyone from anywhere interact with your webapp, but they are increasingly 
doing so from a collection of diverse computing devices: PCs, laptops, tablets, palmtops, 
and even mobile phones. And it’s not just humans interacting with your webapp that 
you have to support and worry about: bots are small programs that can automate web 
interactions and typically want your data, not your human-friendly HTML. In this chapter, 
you exploit Python on Coach Kelly’s mobile phone to write an app that interacts with your 
webapp’s data. 


this is a new chapter 
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going mobile 


The world is getting smaller 

Coach Kelly is continuing to use his webapp every day，but he’s having a 
problem with his new smartphone. 



There's more thaw just desktop computers out there. 

Who knew that your users would try to interact with your webapp using 
something other than a desktop computer or laptop? 

It’s a diverse computing environment out there. 
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mobile app development 


Coach Kelly is cm Android 

The coach has a lovely new smartphone that’s running Google’s Android 
operating system. Sure enough, when you check it out, the web app is way too 
small and not much use on the coach’s three-inch screen: 




^ ocs h3vc a 

^»+yih 9 9 la ss f 


Obviously, the coach needs to access his data and run his webapp 
on his phone...but what’s the best way to do this if not through the 
phone’s browser? 


And doiVt go telling 
me to do all that two- 
fingered zoom and double¬ 
tapping thing. That just 
drives me crazy! 


0 




rpen your pencil 


Open your web browser on your desktop computer (or phone) 
and enter "Python for Android” into your favorite search engine. 
Make a note in the space below of the most promising site from 
your search results: 
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scripting layer for android 

- <|kiharpen your pencil 

Solution 


Is 七 Wis 从 c 。从 


you 


-fouy\d? 




You were to open your web browser on your desktop computer 
(or phone) and enter "Python for Android” into your favorite 
search engine. You were then to make a note in the space below 
of the most promising site from your search results: 


/ Codt ^oo^\t>Corn/ p/ahd\roid-sdvip*tm^ (*the home o-f SL 午 / \ project) 


Ruw Python ow the coach's smartphone 

A quick search of the Web uncovers a pleasent surprise: Python runs on Android. 

At least a version of Python runs on Android. A project called Scripting Layer 
for Android (SL4A) provides technology to let you run Python on any Android 
device. But there’s a catch. 



O 



% 


I ™ 

今 python^ 


Ummmm...I just checked 
the SL4A website, and 
it looks like it supports 
Python 2.6.2, not Python 3. 
Phooey! 



Yes. SL4A ships with Python 2, not 3. 

Python 3, this book’s preference, is the best version of 
Python yet, but it achieves its greatness at the cost of a 
lack of backward compatibility. There’s some stuff in 
3 that will never work in 2 and vice versa. 

Is this fact alone a show-stopper? 
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mobile app development 


Pow't worry about Pythow Z 

The fact that Python 2 is available for Android and you’ve learned Python 
3 in this book is nothing to lose sleep over. Python 2 is still Python, and the 
differences between Python 2 and Python 3 are easy to manage. 

Think about your web app for a minute. Right now, the model, view, and 
controller code resides on the web server, which is running Python 3. 



Youv- v/eb Woy/scv- 
v-uy\s \\crt- • ^^ 



/ tH 1 腦 


The Internet 



All youv* web 
^°de v*uhs hevc. 

If you move the user interaction to the smartphone, the model and some 
of the controller code stay on the server (and continue to run on Python 
3), whereas the view code and the rest of the controller code move to the 
smartphone, where they need to be rewritten to run on Python 2. 



0 




□I 

I 

二 m 


youv- 

亡 ode v»uhs hcvc... 




… avxme o{\\Cr 

\ruy\s V^cvc- 
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android sdk 


Setup your development cwvirowmcwt 

Understandably, the coach won’t let your have his phone to work on until 
you have something that works. Thankfully, Google provides a cross-platform 
Android emulator that lets you develop for the phone as needed, even 
though you don’t own any hardware. 


Pownload the Software Pevelopmcwt Kit (SPK) 

Let’s get started developing for Android. Visit this website and download the 
SDK for your computer and operating system: 

http:/ / developer, android, com/sdk/index.html 



Follow along with 
these instructions to 
ensure you have your 
Android development 
environment correctly set 
up on your computer. 




Android SDK | Android Developers 


(~> 



e 


、 r 


http://developer.android.com/sdk/index.html 


☆ ▼) ( 《 i ▼: Google 




BBC News RTt News 為 C-Mail O’Reilly Radar 灸 Head First Labs 免 LJ - Front 兑 LJ - News 為 Safari CNews Ireland 兑 Twitter 
Android SDK | Android Developers + 


^ [ English J ) And y c 


GODPOO 


dBVBlOl 


Home 




no rcr 





search developer docs 


Dev Guide 

Reference 

Resources 

Videos 

Blog 


Search 


Android SDK Starter Package 


Installing the SDK 

Downloadable SDK Components 

Adding SDK Components 

Android 2.2 Platform n ® w1 
Android 2.1 Platform 
Android 1.6 Platform 
Android 1.5 Platform 
► Older Platforms 

SDK Tools, r7 new, 

USB Driver for Windows, r3 

ADT Plugin for Eclipse 

ADT 0.9.8 new! 

Native Development Tools 

Android NDK, r4b new, 

More Information 

SDK System Requirements 


Download the Android SDK 


Welcome Developers! If you are new to the Android SDK, please read the Quick Start, below, for an overview of how to 
install and set up the SDK. 

If you are already using the Android SDK and would like to update to the latest tools or platforms, please use the 
Android SDK and AVD Manager to get the components, rather than downloading a new SDK package. 





Package 



MD5 Checksum 


Windows 


android-sdk r07-windows.zip 23669664 bytes 69c40c2d2e408b623156934f9ae574f0 
Mac OS X (intel) android-sdk r07-mac x86^ip 19229546 bytes 0f330ed3ebb36786faf6dc72b8acf819 
Linux (i386) android-sdk r07-limix x86.toz 17114517 bytes el0c75da3d1 aal47ddd4a5c58bfc3646 


Done 


A 


The A 灼 dvoid 

SD〆 websi-tc 




Despite what this website might look like it’s telling you, you do not need to 
install Eclipse to run the Android emulator. However, you do need to have a 
Java Runtime Environment installed. If you are unsure about this, don’t worry: 
the Android emulator will advise your best course of action if it spots that 
Java is missing. 


is V^oy/ *bV\c A^dvo'id 
ay looks a-b 七 ‘ c ol 
Y |*t look 3 l.i 七七 

lor you. No Y/o\r\r'iCS ： just 
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Configure the SI?K and emulator 

You need to do two things to configure the SDK and emulator: add an Android 
Platform and create an Android Virtual Device (known as 3.n AVD). 

Add an Android platform 

The coach is running Android 2.2 on his phone, so let’s add a 2.2 platform 
to mimic this setup. Open up the Android SDK and AVD Manager tool, 
select Available Packages, and pick 2.2 for installation. 



TV A^dvo'id dov/y>load to 山 … s 
a ^oldcv tailed 

w a”dbroid” WrtWm 七 Wis 

-foldcv-. 




Android SDK and AVD Manager 


Virtual Devices 
Installed Packages 
Available Packages 
Settings 
About 


Sites, Packages and Archives 

□ https://dl-ssl.google.com/android/repository/repository.xml 
► _ Documentation for Android SDK, API 8, revision 1 


SDK Platform Android 2.2, API 8, revision 


► % w SDK Platform Android 2.1, API 7, revision 2 

► «r SDK Platform Android 1.6, API 4, revision 3 

► t SDK Platform Android 1.5, API 3, revision 4 

► △Samples for SDK API 8, revision 1 

► (2)Samples for SDK API 7, revision 1 

► 兔 Google APIs by Google Inc” Android API 8, revision 2 

► ^Google APIs by Google Inc., Android API 7, revision 1 

► ■ 务 Google APIs by Google Inc” Android API 4, revision 2 

► • 良 Google APIs by Coogle Inc” Android API 3, revision 3 

► & Market Licensing package, revision 1 

t 

Description 

Android SDK Platform 2.2_rl 
Revision 2 



This is -the ohly vcvsioh o( 
"the -that you heed. 


〔 Add Add-on Site... j Delete Add-on Site... ^ Displ ( Refresh 


Create a new Android Virtual Pcvice (AYP) 

With the 2.2 platform downloaded and installed, create a new Android 
Virtual Device. 




Create new Android Virtual Device (AVD) 


Name: droid2.2 




^ivc youv /\\/P a 

d^a sclent a 


Target: Android 2.2 - API Level 8 

SD Card: 




"the siz.c o-P 
vivtual SD^d ： ^/Z is 

你 0 代 "than Chough. 


Cl'itk ov\ 


y his 叫 take a ov- two, 

acpchdihg oh the speed of y ou ^ 
^CuWo\rk dohhCd*tioh. 



Your AVD is 

a simulatect 
Android pkone. 
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emulate sl4a 


Install and configure Android Scripting 

With the emulator ready, use the AVD Manager to start your 2.2 device. Click 
on the emulator’s browser (the little globe), surf to this web address: 


These ihstiru^iohs wovk oh a Val” 

-too. Just be suire -to Chablc 
Mhkhoym souses' io a || ow ^ ov . 

他 Act appli^tioh dowhloads. 


hOh- 


http:/ / code.google, com/p/android-scripting 

and tap on the “boxed” bar code near the bottom of the page: 

Do) wo^y it ^ kcs you ^ ⑽ 一 
oir two -to sia^t The … ulaW 

sU C v tha“hc actual P W... 


a 

is 


0v\ -tV^c cwula*tov-, 

-tap oy \ 七 he 

w boy*ed” b 狄 code 一 

-to s-tav-b *bV\c 
£L^A doY/y\load. 




When the download completes, select the emulator’s Menu button —► More —► 

Downloads^ and then tap on the sl4a_r2 . apk file to install the SL4A The vcvs’kw 
package on the emulator. When the install completes, tap Done. _ / 1 

la*bcs*b v-clcasc. 


available bo you — 七 be 

>u *t (W*b 够 1 dov/^load t\\c 



©Today 


P 


sl4a_r2.apk 

1 android-scirlpting.googlecode.com 
821 KB Download complete. ? 
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Add Pythow to your SL4A iwstallatiow 



verify fi 




❺❹ 


python for android rl.apl 


sl4a.r2.apk 


SSS4 <Jro<d2.2 




4:15 rM 


Return to the emulator’s web browser, double-tap on the screen to zoom in, 
and select the Downloads tab. Double-tap again and tap the following link: 

python 一 for_android_rl • apk _ 

Tap the download link, and tap on the package name to download it. Select 
Menu ― ►More —► Downloads, and tap on the newly downloaded package. 


5 - 5 -S 4 :dro^Z.Z 


vc\rs»oy^ you see 7 啤七 

be 出沁 … U ‘七 W,s . 
st 


pyth on_for_a n d roi d_r1 .apk 

androId-scrlptlng.googIecode.com 
30.97KB Download complete. % 

sl4a_r2,apk 

androld-scrlpttng.googlecode.com 
821KB Download complete. 9 j 


ail €>^14 
android-scripting 


m>Jscc Home 

t»reh cfcwiiuiiL 


Wlhl 




'^y>< d<o 




4 ： 1SrM 


android 


rl.apk 


python for an droid ri 

诗 CktMm: 

t SMA1 thomm 10 


tmy 

UL^.74rii 


Filename * / 

Summai 

4 | sl4a r2.apk / 

sl4a_r2^ 

rhino for android ri aw 

rhino_fo 

Featured 

python for android ri .apk 

python ' 


Featured 

peri for android rl.apk 

perl for 


Featured 


1： 

python for android rl.apk 


1 Checksum: b213ce6f601625e07468fc0a43 
Use the SHA1 checksum shown to verify fil 

卿 . 


The Python for Android app runs. When you are ready, tap Open -> Install 
to complete the installation. This downloads, extracts, and installs the Python 
support files for Android, which can take a few minutes to complete. When 
it does, Python 2.6.2 and Python for Android are installed on your emulator 
and ready for action. 


This last bi-t is really 
p 。 七 ht. 


Let’s confirm everything is working with a quick test. 
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your script on android 


Test Pythow ow Android 

Return to your emulator’s main screen and find an app called SL4A added to your list 
of app icons. Tap this app to display the list of Python scripts preinstalled with Python 
for Android. Simplty tap on any script name to execute it: 



TV>c 

Wtbcm. 


Be sure to set 
the SL4A 
rotation mode 
to automatic. 


Your screen might 
switch to landscape by default 
the first time you run a script 
To fix this, choose Menu 


A r 


SSS4 ： drofd2.2 


3RDG 8:38 pm I 


Scripts 

bluetooth_chat.py 
hello_world.py 
notify.weather.py 
iQl say.chat.py 
sayjime.py 
*8* say_weather.py 

♦ speak.py 
take_picture.py 

^test.py 

• weather.py 




© O ® © 


1 
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eg 
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@ 


/ 


」 


Take your Android emulator for a spin 


Preferences, scroll down to 

Rotation mode, and set its 


Here’s a four-line Python script that you can create to test your installation. 
Let’s call this script mydroidtest. py: 


value to Automatic. 


|wpov •七七 he w air\dvo»d 
a 代 objcC-*t i^S*b3ir\tC- 


Cyrcatc dh appvopv-ia-tc 

3h d display it ^ 


import android 

app = android.Android() 

msg = "Hello from Head First Python on Android" 
app.makeToast(msg) 


To transfer your script to the emulator, you need to copy it to the emulator’s 
virtual SD card. Another program within the tools folder called adb helps 
with this: 


this „d 銑 y 。 ⑽ 七 ㈣ 
7； hdoW ^ 仏一 w y 。 冰 sM?i ^ 

tnc Cmula-fcov. 




Your script should now appear on the list of scripts available to SL4A. 
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Tesr DriVq 


Let’s confirm that your Android setup is working. With the SL4A app open, simply tap on your script’s 
name to run it, and then click the run wheel from the menu. 




5554:droid2.2 


a ?? 


s 


… tkh d\ck the 

Vuh wheel. W 




I 

I mydroidtesLpystarted^^^^^ 



\<M 5:03 


Scripts 

•gifindjt.py 
$ get2inputsapp.py 
争 hello_world.py 
$ marathonapp.py 


O 

Oj 




争 bluetooth_chat.py 
$ coachapp-KEEPER.py 
coachapp.py 
•gifind_it.py 

get2inputsapp.py 
hello_world.py 
争 marathonapp.py 


Hello from Head First Python on Android 


./ — 

say_chat.py ' 


1 

0 i 
2 

— •. 

3 

4 

5 

6 

■ 

8 



Q 

W 

E 

R 

T 

y| 

U B 

j 

0 


A 

s 

D 
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G 

H 

j 

K 1 

L 

a： 

心 

□ 

z 

X 

c 

V 

B 

N 

M 



ALT 


L. 

— i 




s youv- message- l*t 

v/ov-ks) 


Your Android 
emulator with SL4A 
is working, and it’s 
running your Python 
code. 
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what to do? 


Pcfiwc your app's requirements 

Let’s think a little bit about what your Android app needs to do. 



Frank: Well.. .first off, the view code no longer has to generate HTML, 
so that makes things interesting. 


Jill: In fact, you need the web server only to supply your data on 
request, not all that generated HTML. 

Joe: Ah ha! I’ve solved it. Just send the pickle with all the data from the 
server to the Android phone. It can’t be all that hard, can it? 

Jill: Sorry, guys, that’ll cause problems. The pickle format used by 
Python 3 is incompatible with Python 2. You’ll certainly be able to send 
the pickle to the phone, but the phone’s Python won’t be able to work 
with the data in the pickle. 


Frank: Darn...what are our options, then? Plain data? 

Joe: Hey, good idea: just send the data as one big string and parse it on 
the phone. Sounds like a workable solution, right? 


Jill: No, that’s a potential disaster, because you never know in what 
format that stringed data will arrive. You need an data interchange format, 
something like XML or JSON. 


Frank: Hmm. • .I’ve heard XML is a hound to work with.. .and it’s 
probably overkill for this simple app. What’s the deal with JSON? 

Joe: Yes, of course, I keep hearing about JSON. I think they use it in 
lots of different places on the Web, especially with AJAX. 

Frank: Oh, dear...pickle, XML, JSON, and now AJAX...I think my 
brain might just explode here. 


Jill: Never worry, you only need to know JSON. In fact, you don’t even 
need to worry about understanding JSON at all; you just need to know 
how to use it. And, guess what? JSON comes standard with Python 
2 and with Python 3... and the format is compatible. So, we can use 
JSON on the web server and on the phone. 

Frank & Joe: Bonus! That’s the type of technology we like! 
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J$ON 

This week’s interview: 

The Data Interchange Lowdown 


Head First ： Hello, JSON. Thanks for agreeing to 
talk to us today. 

JSON ： No problem. Always willing to play my part 
in whatever way I can. 

Head First ： And what is that, exactly? 

JSON ： Oh, I’m just one of the most widely used 
data interchange formats on the Web. When you 
need to transfer data over the Internet, you can rely 
on me. And, of course, you’ll find me everywhere. 

Head First: Why ’s that? 

JSON ： Well. ..it’s really to do with my name. The 
“JS” in JSON stands for “JavaScript” and the “ON” 
stands for “Object Notation.” See? 

Head First: Uh . I m not quite with you. 

JSON ： I’m JavaScript’s object notation, which 
means I’m everywhere. 

Head First ： Sorry, but you’ve completely lost me. 

JSON ： The first two letters are the key ones: I’m 
a JavaScript standard, which means you’ll find me 
everywhere JavaScript is.. .which means I’m in every 
major web browser on the planet. 

Head First ： What’s that got to do with Python? 

JSON ： That’s where the other two letters come 
into play. Because I was initially designed to allow 
JavaScript data objects to be transferred from one 
JavaScript program to another, I’ve been extended 
to allow objects to be transferred regardless of what 
programming language is used to create the data. 

By using the JSON library provided by your favorite 
programming language, you can create data that 
is interchangeable. If you can read a JSON data 
stream, you can recreate data as you see fit. 

Head First ： So I could take an object in, say, 


Python, use JSON to convert it to JSON’s object 
notation, and then send the converted data to 
another computer running a program written in C#? 

JSON ： And as long as C# has a JSON library, you 
can recreate the Python data as C# data. Neat, eh? 

Head First ： Yes, that sounds interesting...only 
[winks] why would anyone in their right mind want 
to program in C#? 

JSON ： [laughs] Oh, come on now: be nice. There’s 
plenty of reasons to use different programming 
languages for different reasons. 

Head First ： Which goes some of the way to explain 
why we have so many great programming titles, like 
Head First C#，Head First Java, Head First PHP and 
MySQL, Head First Rails, and Head First JavaScript. 

JSON ： Was that a shameless, self-serving plug? 

Head First ： You know something...I think it might 
well have been! [laughs]. 

JSON ： [laughs] Yes, it pays to advertise. 

Head First ： And to share data, right? 

JSON ： Yes! And that’s exactly my point: when you 
need a language-neutral data interchange format that is 
easy to work with, it’s hard to pass me by. 

Head First ： But how can you be “language neutral” 
when you have JavaScript in your name? 

JSON ： Oh, that’s just my name. It’s what they 
called me when the only language I supported was 
JavaScript, and it kinda stuck. 

Head First ： So they should really call you 
something else, then? 

JSON: Yes, but u WorksWithEveryProgramming 
LanguageU nderTheSunlncludingPythonObject 
Notation” doesn’t have quite the same ring to it! 
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leaving pickle on the plate 



This is NOT cool... I spent all that time 
learning to use pickles and now you re 
abandoning them in favor of this ''JSON 1 
thing. You’ve got to be joking...? 


You are not exactly ^abandoning’’ pickle 

The JSON technology is a better fit here for a number 
of reasons. First of all, it’s a text-based format, so 
it fits better with the way the Web works. Second, it’s 
a standard that works the same on Python 2 and 
Python 3, so there are no compatibility issues. And 
third, because JSON is language-neutral, you open 
up the possibility of other web tools written in other 
programming languages interacting with your server. 

If you use pickle here,jow lose all this. 
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一 0 / An IDLE Session 


JSON is an established web standard that comes preinstalled with Python 2 and Python 3. The JSON API is not that 
much different to the one used by pickle: 

一 N the JgOH libvavy. 

»> import json 

»> names = ['John ', ['Johnny ', ， Jack '], ， Michael', ['Mike ', ' Mikey ', ' Mick']] 

»> names 

['John ', ['Johnny ', 


Jack'], 'Michael I, ['Mike ' r ' Mikey ' r ' Mick']] 

TV 扣 s*Po\rm 七 he Python lisU-lists i^rto a JSO/V lisi o-f lists. 






»> to_transfer = json.dumps (names) 

»> to_transfer 

'["John", ["Johnny", "Jack"], "Michael", [ M Mike M , "Mikey", M Mick M ]]' 


The -fovwa-t is sWilan 
W 七出 * 七 . 


»> from_transfer = 
»> from_transfer 
['John ', ['Johnny', 

»> names 

['John ', ['Johnny', 




Tra^o^ the JgQH list of lists back 


json *i^l s(to - transfer) •… 铋⑽ that Pytho, u,de^ h ds. 


'Jack '] r 'Michael ', ['Mike 1 , 'Mikey 


'Mick']] 

_ TV^c ^ data is c 呼 I7 严 samC 

as {\\t orijmal list o\ lists. 


'Jack '] r 'Michael I, ['Mike ', ' Mikey ', 'Mick']] 


(^Sharpen your pencil 


Add a new function to the athletemodel module that, when 
called, returns the list of athlete names as a string. 

Call the new function get names from store (). 
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athletemodel function 


^ Sharpen your pencil 
、、 Solution 


You were to add a new function to the athletemodel module 
that, when called, returns the list of athlete names as a string. 

You were to all the new function get names from store () 


. 巧二 har 七力 : ........ . 乙 今士』 .# da^ ^or, Ihe pidkle. 

, . athletes =• <xe*t -from s*to\rcO 

Ubr^ti a list . 3 …一 …•… 一 . 

七 c 扒 awes - 夕 response 二 Ca-thle-tcsCcadK^a-thJ.hamc -for cadK_a*tK *m athletes] 

•(•VOW' 七 ViC (^3*^3. 

\rc*tu\rh(vcspohSc) 

*bV^c r»s*t *b> Cd\\t>r- 


0 


O 


So...rather than running 
a CGI script to create a HTML 
web page, you want me to deliver 
just the data, right? That's OK. Not 
a problem—just be sure to tell me 
which script to run... 
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With your new function written and added to the athletemodel module, create a new CGI 
script that, when called, returns the data from the get_names_from_store () function to 
the web requester as a JSON data stream. 

Call your new script cgi-bin/generate—names • py. 

Hint ： Use application/j son as your Content-type. 



I may be small, but Tm 
mighty capable. Whether 
you need a web page or just 
your data, you can count on me 
to get the job done. 
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json-generating cgi script 


夸 se 

SoLutvo 


With your new function written and added to the athletemodel module, you were to create 
a new CGI script that, when called, returns the data from the get—names—from—store () 
function to the web requester as a JSON data stream. 

You were to call your new script cgi-bin/generate names . py. 


Poy\ ’七 fo'ry 七七 W’s 
-f ivst Imc 
i-f youVc 

oy\ L-mu% ov Mad 

osx 


一 ^ 养 ! /us\r/lodal/bm/pY*thor3 


impo\rt jsoh 1 

impori 薇 Wdel ^ y ouv * — 。士 . 

i 叶 o\rt ya*tc ) 


■ l r l n - -- ^ "the daia -Pirom 

^a^es =■ athle 七 emodelyt 一一七矿 0 你一 stoveU 、 "the model 

S*ta\rb ^ . :• .. ^ . 

3^\rof\r'ia*bc " 

| mc . 、 ^ f m 七 ( 户七 C.start 一 vrs]j>ohse(’a^ka*ti<W)soh ’)） ^饮七 \ awCS ” ， 七 tovwcrb 

pr’m 七 (jsor\.dum”(so\rted(h5mes))) -- 



Watch it! 


Take care testing 
your JSON-generating 
CGI code. 


The behavior you see 
when testing your JSON- 
generating CGI script will differ 
depending on the web browser you 
are using. For instance, Fire fox might 
attempt to download the generated 
data as opposed to display it on screen. 
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Tesr DriVq 


If it is not already running, start your web server and be sure to set the executable bit with the 
chmod +x cgi-bin/generate—names • py command (if on Linux or Mac OS X). When you’re 
ready, grab your favorite web browser and take your new CGI for a spin. 

匕 W 如 W 说邮 oUk C$U 7 喊 
broxsev's lotat'on bav. 




httpLy/loca[host:8080/Ggi ； -biin/gen'erate_names.py 


hitp://localhost:80S0/cgi-bin/geniefate_names.py 


C i Q 7 Google 


□P 5555 Apple Yahoo! Coogl-e Maps VouTube Wikipedia Popular’ 


I 11 James Lee 11 , 11 Julie Jones'* , ^Hikey McManus' 1 , ^Sally Sanchez" ,, n Sarah Sweeney r， , "Vera Vi" ] 



Wcy/ li looks like -the toat\\ has 

added -two hew aUlcics. 



A 


TV >/c 1 d scrMtrs 
lo^rn^ m-fov-wa*t'ioy\ 

C.oy\*f iv-ws 七七 ^ 

C 6 {\ c%ctu*bcd. 


File Edit Window Help GeneratingJSON 


$ python3 simple—httpd.py 
Starting simple httpd on port: 


8080 


localhost 

localhost 

localhost 

localhost 

localhost 

localhost 


[18/Sep/2010 06 : 31:29] "GET /cgi-bin/generate_names.py HTTP/1.1" 200 - 
[18/Sep/2010 06 : 35:29] "GET /cgi-bin/generate 一 list.py HTTP/1.1" 200 - 
[18/Sep/2010 06:35:35] "POST /cgi-bin/generate_timing_data.py HTTP/1.1" 200 - 
[18/Sep/2010 06:35:38] "GET /cgi-bin/generate 一 list.py HTTP/1.1" 200 - 
[18/Sep/2010 06:35:40] "GET /index.html HTTP/1.1" 200 - 
[18/Sep/2010 06:35:49] "GET /cgi-bin/generate names.py HTTP/1.1" 200 - 


That worked! 

Now all you have to do is arrange for the Android emulator to request the 
data within a Python script and display the list of names on the smartphone’s 
screen. How hard can that be? 
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two apis 


The SL4A Android API 


The SL4A technology provides a high-level API to the low-level Android API, 
and SL4A’s API is documented in the online API reference: 


http:/ / code.google, com/p/android-scrip ting/wiki/ApiReference 

Recall the code from earlier, which demonstrated a minimal Android SL4A 


app: 

|wfov*t w ay\dvoid 

|-,Wa^7 ertait a ^ 


Create dh appvopv-ia-tc ^ 
•^«sa 9c 3h d display it ^ 



import android 

app = android.Android() 

msg = n Hello from Head First Python on Android' 1 
app.makeToast(msg) 


Six calls to the Android API let you create a list of selectable items in a dialog, 
together with positive and negative buttons, which are used to indicate the 
selection your user made. Note how each of the calls to the Android “dialog” 
API results in something appearing on screen. 



Always stavt wi-th import 


import android 


app = android.Android() 


Create 孙 h^A>ro\A 

乙七 . 


app.dialogCreateAlert("Select an athlete : 
app•dialogSetSingleChoiceltems(['Mikey', 'Sarah', 'James', 'Julie']) 
app.dialogSetPositiveButtonText( n Select 
app•dialogSetNegativeButtonText("Quit") 




Display youv dialog 
ihc phohe. 


Wait ^ a 
Jfyom 产 uSCV *. 


resp = app.dialogGetResponse().result 


app.dialogShow() 
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Android Code Magnets 



All of tw»s 
) 

s 

messages art m 
emc flatc. 


The hdme 

of the C^l 

s^ipt -to v*uh 
the web 


scv-vcv- 


TWis todc s a 

rv>css...C-3^ 认 

(\% \t? 



Here is the code to a program that queries your web server for the list of names as a JSON array 
and then displays the list on the smartphone. The only trouble is, the second half of the program 
is a bunch of mixed-up code magnets at the bottom of the screen. Your job is to rearrange the 
magnets to complete the program. 

import android 


import j son 
import time 

from urllib import urlencode 
from urllib2 import urlopen 


Do "the usual imp 0 \r-ts...-thcsc 
ohCS pull ih web dlicht 
-ruh^tiohality. 



hello—msg 
list—title 
quit—msg 
web—server 
get names cgi 


"Welcome to Coach Kelly's Timing App' 
'Here is your list of athletes : ' 
"Quitting Coach Kelly's App. M 
1 http://192.168.1.33: 8080' <z. _ 


' / cgi-bin/generate names.py' 


tr 


def send_to 一 server(url, post_data=None) : 
if post_data : 

page = urlopen(url, urlencode(post—data)) 
else : 

page = urlopen(url) 
return(page.read().decode( M utf8 M )) 




*tWis *to 

vwrm … 3 Y ouV " …士 

scv-vc\r. 

This -fuh^tioh -bkes both a 

wcb u\) ahd some 

opWal daia (post—data) 
ahd schds a web 

y 财 web The web 

the 

Gild 


athlete names = sorted (: j son • loads (send_to_server (web 一 server + get 一 names 一 cgi))) 


status 


update (qu ： 


_msg) 


^esp 


ap p 


dialogGetR, 


app. dialogShow () 


result 


app•dialogCreateAlert(list 一 title) 


def status—update (msg, how_long=2) : 
app.makeToast(msg) 

time.sleep(h ow 一 long) _ 

app•dialogSetNegativeButtonText( f Quit 1 ) | 


status 一 update(hell 


o 


msg) 


app^^^^g^j= veButtonText (t Select f) 

app = android.Android() 
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android query 


Android Code Magnets Solution 



Here is the code to a program that queries your web server for the list of names as a JSON array 
and then displays the list on the smartphone. The only trouble is, the second half of the program 
is a bunch of mixed-up code magnets at the bottom of the screen. Your job was to rearrange the 
magnets to complete the program. 

import android 
import j son 
import time 

from urllib import urlencode 
from urllib2 import urlopen 


hello—msg 
list—title 
quit_msg 
web—server 
get names cgi 


"Welcome to Coach Kelly's Timing App' 
'Here is your list of athletes : ' 
"Quitting Coach Kelly's App. M 
'http://192.168.1.33:8080' 

' / cgi-bin/generate names.py' 


def send_to 一 server(url, post_data=None) : 
if post—data: 

page = urlopen (url , urlencode(post_data)) 

Orca 七 c ah A^dvo'id else: 
a?? obj 仏七 . 

- 1 0,1 

messages OY\ ttc 

.• ， y\\oy\C. . 


W. 


page = urlopen(url) 
return(page.read() .decode( M utf8 M )) 

app = android.Android() 


def status 一 update(msg, how_long=2) : 
app.makeToast(msg) 
time.sleep(how 一 long) 


TWis is d I'iUIc 

⑶二 trb Scd the web 

… •、 .y°^ sevvev, thch 

tuv-h the v-cspohsc 
.i»vto d soirted list. 



status 一 update(hello msg) 

__ 

athlete names = sorted (j son • loads (send_to 一 server (web 一 server + get 一 name s— cgi))) 


app•dialogCreateAlert(list 一 title) 


app.dialogSetSingleChoiceltems(athlete names) 
app.dialogSetPositiveButtonText('Select▼ 
app.dialogSetNegativeButtonText( f Quit') 




Create a W - WtWd 

dialog -fv-ow lis*b o+ 


resp = app.dialogGetResponse(). 


result ~ 



^ ^ ^ buiU 

tkh assi jh the iresuii "to Vcsp w . 


Say w — 
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Tesr DriVq 


Recall that (for now) your Android Python scripts run within the emulator, not within IDLE. So use the 
tools/adb program to copy your program to the emulator. Call your program coachapp . py. When 
the code is copied over, start SL4A on your emulator, and then tap your script’s name. 





Ta\> Y ou,r a ?? s 
栋 cwba? 七 ^ 






A 


SSS4 droid2.2 


bluetooth.chat.py 
coachapp.py 


say.cha/ py 

♦ say_tim【py — 
ig> say_wea\^r.py 

♦ showdialogJS^ 

♦ speak.py 

iQi take.picture.py 


0 0^)0 






SSS 个 druidU 


n：42 aw 


Here is your list of athletes 


Q James Lee 
|1 Julie Jones 
I Pvlikey McManus 
E Sally Sanchez 
P Snrah Sweeney 






SiPiPC ： 




5YM 


^ they airc...Co^h 
^llys athletes. 






DIL 


5YM 


This is looking really good! Your app has communicated with your web server, 
requested and received the list of athlete names, and displayed the list on your 
emulator. 



If you app doesn’t run, don’t panic. Check your code for typos. 

Run your app again in the Python terminal by tapping on the little terminal icon to the 
left of the “run wheel” within SL4A. If your code raises an error, you’ll see any messages 
on the emulator’s screen, which should give you a good idea of what went wrong. 
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positive or negative 


Select from a list ow Android 

When your user taps on a button, the “result” of the call to 
dialogGetResponse () is set to positive if the first button is tapped 
or negative if the second button is tapped. In your code, you can check 
the value of resp, which is a dictionary, and the which key is set to either 
positive or negative. 

A subsequent call to dialogGetSelectedlterns () returns the index 
value of the selected list item. 





55S4:droid2„2 


hdex i-tem O 


Index i-tem / 


i*tcrw Z 






11:42 


AM 


Here is your list of athletes 


ames Lee 


JuheJones 


Mi key McManus 


Sally Sanchez 


Sarah Sweeney 


Se ea 


Qui: 


“positive" but-fcoh 


O Q ® O 


珍 I 嫌 ^ 资 I ❷ 〗 


I naaBaaBaao 

「 WWMWFWWWF 


D F 


ALT 


B 『遲 
alt 


TV W 七 “ 


So.. .if the positive button is tapped, you can index into the list of athlete names 
to see which athlete was selected from the displayed list. The selected name can then 
be sent to the web server to request the rest of the athlete’s data using the send— 
to_server () function. 

You can use this behavior in the next version of your code. 
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mobile app development 


^ Sharpen your pencil 



Assume that you have a CGI script called cgi-bin/ 
generate—data • py, which, when called, requests the data 
for a named athlete from the server. 

Provide the code (which includes a call to thensend_to_ 
server () function) to implement this functionality: 


© Additionally, write the code required to display the list of times returned from the server within an Android 
dialog. 

Hints: Use the dialogSetltems () method from the Android API to add a list of items to a dialog. Also, 
remember that the data arriving over the Internet will be formatted using JSON. 
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ask for an athlete 


^ Sharpen your pencil 

Solution 



❶ 


You were to assume that you have a CGI script called cgi-bin/ 
generate_data . py, which, when called requests the data for 
a named athlete from the server. 

Pv-ov'idc 七 he You were to provide the code (which includes a call to 

i\\c C^l ^ - the send_to_server () function) to implement this 

functionality: 


y 七一 data 一 qi 二 ’/d 汐一 bm/daia py^ 

schd_*to_sc\rvc\r(wcb_sc\rvc\r + { ； whidh_a*thlc*tc^ whidh_a*thlc*tc}) 

■toy 七一仏七 ^ 个 

3^V>lc*bc \ 一 / v-l^tludc da*ta- 


o 


Additionally, you were to write the code required to display the list of times returned from the server within 
an Android dialog: 



Whi 匕 h bu-fc-fcoh was pvcsscd? 


lA/V^c 扒 vouv- uscv- i-f rts^C\NW\C\\3 m (’positW〆 )： 

七 Vjc w ^os"i*t"wc 

bJUcm >wov-k ou*t selected—athlete 二 app dialo^etSeled*tcd|*te^s().\resul*tCO] 

仏 c rndcx. value 

£,V\oscy\. . 




Look p 仏 二 a*thle*te_hames[seled*ted_a*thle*te] 

s usih0 
"the ihdex value. ... 


pY 扒 awitallY 

extait *b^c 
dialogs 七 rtlc 


athlrtc — jsohloads(schd_*bo_sc\rvc\r(y/cb_sc\rvc\r + yt 一 data—dgi, 



a*thle*te_*ti*tle 二 y/hidh_a*thlc*tc + ; *top 3 *ti^cs： J 



TV mdex. value 
is m i\\t C 打七 
clc^c^*b *tV>c 
\\si Jc results 
vctuvy\cdi "t^c 
dialog 


■Send e) hCW 
web irc^ucs-t 
io the 

SCV-VCV 

io ^cUh the 

aihlc-tcs daia. 


appdialo^Crca*tcAlcr*t(a*thlrtc — *ti*tle) 


T\\t usev- y^ccds 
{p sec or\^l 

da*ta *tWis tiwc, so 

you y\ccd ^ 

w d'ialo^c*tl*bcws() w . 


appdialo5£e*tl*tc^s(a*thlc*ter7op^3) 
app-dialogSctPosi-tivcBu-ttohlcTC-t^O^O 
app.dialc^ShowO 


.Set -bVic srn^c* 
feu*b*to^ ，s 七 e 乂七 . 


l^it -fov- a -tap . •• . . .>.. Vn . ；； . ; V 

-fvorn the usev ' 一 " ^ 代邛 二 ^pp dialog^ctRcspohscO.rcsult 
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The athlete's data CW script 


Here’s the code for the cgi-bin/generate_data . py CGI script, which 
takes a web request and returns the indicated athlete’s data from the model: 


#! /usr/local/bin/python3 

import cgi 
import json 

import athletemodel 6fci dll -fchc daia 

import yate the rnodel. 

Pv-otcss 

sen athletes = athletemodel • get—from 一 store () 

七 ^form—data = cgi . Fieldstorage () 

athlete s - 汐 athlete—name = form—data [ ， which—athlete'] .value 

print(yate.start_response('application/json')) 

print(json.dumps(athletes[athlete name])) 

〜一 


f 



S-birt a web 

代 sp 0hSC , wi-th JgOH 

as dsia type. 


The complete Android app, so far 


l^tludc *b^c md^a-bed 


You’ve made quite a few changes to your program at this stage. Before you test it 
on the Android emulator, take a moment to look at your code in its entirety. 


import android 
import j son 
import time 

from urllib import urlencode 
from urllib2 import urlopen 


hello msg : 

="Welcome to Coach Kelly's Timing App M 


list title : 

: 'Here is your list of athletes : ' 


quit msg = 

="Quitting Coach Kelly's App. M 


web server = 

= 1 http://192.168.1.34:8080' 

T\\t v-cst 0^ youv- 



CoAt is or\ 七 he 

get names cgi = 

='/cgi-bin/generate names.py' 

-folloWm^ 

get data cgi = 

=' / cgi-bin/generate data.py' 
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app code, continued 


def send_to 一 server(url, post_data=None) : 
if post—data: 

page = urlopen (url, urlencode(post_data)) 
else : 

page = urlopen (url) 
return(page.read().decode( M utf8 M )) 

app = android.Android() 

def status—update(msg, how 一 long=2): 
app.makeToast(msg) 
time.sleep(how 一 long) 

status—update(hello 一 msg) 

athlete names = sorted(json.loads(send_to 一 server(web—server + get—names 

app.dialogCreateAlert(list—title) 

app•dialogSetSingleChoiceltems(athlete names) 

app.dialogSetPositiveButtonText('Select') 

app.dialogSetNegativeButtonText('Quit 1 ) 

app.dialogShow() 

resp = app.dialogGetResponse().result 

if resp['which'] in (’positive'): 

selected—athlete = app•dialogGetSelectedltems().result[0] 
which athlete = athlete names[selected—athlete] 

athlete = json•loads(send_to—server(web—server + get_data 一 cgi, 

{'which athlete' : which athlete})) 

athlete 一 title = athlete['Name'] + ' (' + athlete['DOB'] + '), top 3 

app.dialogCreateAlert(athlete 一 title) 

app.dialogSetltems(athlete['Top3']) 

app.dialogSetPositiveButtonText('OK') 

app.dialogShow() 

resp = app.dialogGetResponse().result 
status—update(quit_msg) 


cgi))) 


times : 
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Tesr DriVq 


Let’s give the latest version of your app a go. Copy the app to your emulator, and put the new CGI 
script in your cgi-bin folder on your web server (remember to set the executable bit, if needed). 
What happens when you run your latest app using the emulator’s Python shell as opposed to the 
"run wheel”? 


You avc dumped 

sV>cll ^ a 

nasty c 代 ov " wcssa 5 c * 




© @ 


w cssa 5 c, -to ycWv. 


« r> 


5554:droid2.2 


MENU 


1 

2 

3 

4 

5 

6 


8 

9 

0 

Q 

W 

E 

R 

T 

Y 

u 

I 

0 

P j 

A 

s 

D 

F 

G 

H 

J 

K 

L | 

DEL 

<E2 


Z 

X 

C 

V 

B 

N 

M 

• 

m 


SYM 

@ 

i i 

wrn^ 


Traceback (most recent call last): 

File "/ ■nt/sdcard/sl4a/scrlpts/coachapp.py 11 


9 ■tn <| jodule> 
app^^log 

TypeError: Im 


ogSetIteas(athlete['Top3']) 

1st Indices Bust be Integers, not str 


Process has exited. 
Close terminal? 


Yikes! Your code has a TypeError, which is crashing your app when you try 
to display the selected athlete’s timing data. Why do you think this is happening? 
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debugging data 


The data appears to have changed type 



Let’s add a debugging line of code to your CGI script to try and determine what’s 
going on. Recall that the CGI mechanism captures any output your script sends 
to standard output by default, so let’s use code like this to send your debugging 
messgage to the web server’s console, which is displaying on standard error. 



s*tay\dav-d I'lWav-y- 


import sys 


print(json.dumps(athletes[athlete_name ]), file=sys.stderr) 


Run your app again and, of course, it’s still crashes with a TypeError. 
However, if you check your web server’s console screen, you’ll see that the 
data being sent as the JSON web response is clearly visible. Notice anything? 



Redded the ou-tpu-t 
w pHhtO w -to 

thah the de-fault, 
whi 匕 h is w stdout w . 


TWis k a lis 七 d 
a*Wc 七 c 七 W” ， 

values...feu-t 

七 he 

POB values? 


$ python3 simple—httpd.py 
Starting simple—httpd on port: 8080 

192.168.1.33 - - [18/Sep/2010 17:40:04] "GET /cgi-bin/generate_names.py HTTP/1.1" 200 - 
192.168.1.33 - - [18/Sep/2010 17:40:08] "POST /cgi-bin/generate_data.py HTTP/1.1" 200 - 
["2-44", ”3:01", "2.44", "2.55", "2.51", "2:41", "2:41", "3:00", "2-32", "2.11", "2:26"] 
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JSON caw’t handle your custom datatypes 

Unlike pickle, which is smart enough to pickle your custom classes, the 
JSON library that comes with Python isn’t. This means that the standard 
library’s JSON library can work with Python’s built-in types, but not with 
your AthleteList objects. 

The solution to this problem is straightforward: add a method to your 
AthleteList class to convert your data into a dictionary, and send that 
back to the app. Because JSON supports Python’s dictionary, this should work. 



Let’s create a new method in your AthleteList class. Called to—diet (), your new 
method needs to convert the class’s attribute data (name, dob, and top3) into a dictionary. Be 
sure to decorate your new method with ©property, so that it appears to be a new attribute to 
users of your class. 



What’s the purpose of this @property thing again? 

The @property decorator lets you specify that a method is to be presented to users of your class as if it were an attribute. If you 
think about things, your to_dict () method doesn’t change the state of your object’s data in any way: it merely exists to return the object’s 
attribute data as a dictionary. So, although to—diet () is a method, it behaves more like an attribute, and using the @property 
decorator let’s you indicate this. Users of your class (that is, other programmers) don’t need to know that when they access the to_dict 
attribute they are in fact running a method. All they see is a unified interface: attributes access your class’s data, while methods manipulate it. 
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data to dictionary 


ExeaciSe 

SoLutvo 


Let’s create a new method in your AthleteList class. Called to—diet (), your new 
method needs to convert the class’s attribute data (name, dob, and top3) into a dictionary. Be 
sure to decorate your new method with ©property, so that it appears to be a new attribute to 
users of your class. 


Pctov-a*tc 7 0U，r @propcr*ty 

method V/»*tn - •/ ... 

dc-f as_diid*t(sd-f )： ^ c a hCW 




{ V0B >: scl-f.dob, 


孓 ’ ： sel-f.*top^}) 



Did you V*crncrwbc\r -fco use W scl-f W ? 


Rc*tuvy> a did*t'ior>av-y o( ttc objert i 

data atbribu 七 es. 





As well as updating your AthleteList 
class code, be sure to change egi-bin/ 
generate-data . py to return a 
dictionary, rather than the object instance, 
when servicing its web request. 

While you’re making changes, adjust the 
coachapp . py app code to include the 
athlete 5 s name and DOB values in the 
second dialog’s title. 
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Tesr DriVq 


With your changes applied to AthleteList. py, cgi-bin/generate_data . py and 
coachapp . py, use the adb tool to copy the latest version of your app to the emulator. Let’s see 
how things work now. 



Here 


s your list of athletes: 


« n n 


coachapp.py - /Users/barryp/HeadFirstPython/chapter8/coachapp.py 


Here’s 仏 c toAt 
七七 y ouV " uscs 

•m v-cspoy\sc *to 


if resp[ 'which' ] in ( 'positive ' ) : 

selectedathlete = app.dialogGetSelectedltems().result[0] 

whichathlete = athletenames[selectedathlete] 

athlete = json.loads(sendtoserver(web server + get data cgi, 

{ 'wAich 二 athlete■ : whichathlete})) 


athlete_title = athlete[ 'Name 1 ] + _ ( 
app.dialogCreateAlert(athlete_title) 
app.dialogSetltems(athlete[ 'Top3 1 ]) 
app.dialogSetPositiveButtonText( 'OK' ) 
app.dialogShow() 

resp = app.dialogGetResponse().result 


+ athlete[ 'DOB' ] + '), top 3 times 


lames Lee 




Julie Jones 


MENU 


Success. 

Your app displays the selected 
athlete 5 s top three times on 
screen. How cool is that? 


status_update(quit_msg) 


Ln: 55 Col: 0 


« rs 


5554:droid2.2 


5554:droid2.2 


SYM 


am)© 7：29 


Mi key McManus) 




Sally Sanchez 


© Sally Sanchez (2002-11-24), 
top 3 times: 


Sarah |weeney 


2.11 


Quit 


2.26 


2.31 


amie 7：29 
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file transfer over wifi 


Run your app on a real phone 

Now that your app is running successfully on your emulator, it’s time to try it 
on a real phone. This is where things get interesting. 

There are many options when it comes to copying your code to a real device: 

• Use file transfer over Bluetooth. 

• Use file transfer with a USB connection. 

• Use the Android SDK’s adb tool with USB. 

• Use a file transfer tool over WiFi. 

Unfortunately, which technique to use (and which work) depends very much 
on your phone. 

At Head First Labs, we’ve had the greatest and most consistent success with 
the last option: use a file transfer tool over WiFi. 



These 
instructions 
do not work 
on the 
emulator. 


The Android emulator 
does not currently support 
Goog/e's Android Market ， 
which you’ll need access to 
use when following along 
with the instructions on 
these pages. 


Step 1: Prepare your computer 

To transfer files securely between your Android phone and your computer, 
enable SSH file transfers by running an SSH server on your computer. How 
you do this depends on the operating system you are running: 

• Windows: download one of the many free SSH servers. 

• Mac OS X: enable remote logins. 

• Linux: install and enable OpenSSH Server. 


Step Z: Install AwdFTP ow your Android phone 

Use the Android Market on your phone to find and install the AndFTP app. 
This excellent tool lets you transfer files to and from your Android phone over 
FTP, SFTP, and FTPS. 

To use it with the SSH server running on your computer, you’ll want to select 
SFTP as the file transfer protocol within the app, because AndFTP defaults 
to using the FTP protocol. 


Let’s take a look at what’s involved. 



丁 he AndFTP app i s 
OhC o-f ouv -faves. 
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Configure AwdFTP 

With AndFTP running on your phone, configure it to connect to your 
computer {Hostname) using SFTP as the transfer protocol {Type). Leave the Port, 
Username, Password, and Remote dir entries as they are, but change the Local dir 
entry to / sdcard/sl4a/scripts. 



*tw»s 

fee v/cb or 
addv-css <Jc Y ou，r 


scv-vcv-. 


Set th.s io Vsd^d/sl^a/sMpis^ 

^ U]r) 《 *fil« 〆 

y° u,r s cirvcir arc added h> 

SL 午 A 


It 11:03 PM 


FTP server settings 


_wn< 




yourserveirxcmi 


Type ： 


FTP {File Transfer Prc 


optional (default is 21) 


optional 


UwrTnam#: 


optional 


Password:: 


/sdcard 


/yourfolder 






Be suve io sc i 

this "to u SFTp w 

( X hcv ^4v 

fM" should 

io 22. 


Be suv-c bo ta? w Savc". 


With the connection set up, tap AndFTP’s Connect button to establish a 
connection to your SSH server, entering your Username and Password when 
prompted. 

With the connection to the server established, navigate to the server folder 
containing the file(s) you want to transfer to the phone, mark the files for 
download, and tap the Download button. 

When the download completes, click Disconnect to terminate the connection 
between the phone and your computer. If you transferred a Python program, 
it should now be added to the list of scripts within SL4A. 

It’s time to let Coach Kelly take a look. 



^ b iu*mih m ch 

备 hell 。 扣他 . p 
8* n Wiiy_we S i f) p 

S* Siy_chat,py 
^^yjme.py 
^y-m^ther.py 

1 ^p^k. py 
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app complete (almost) 


The coach is thrilled with his app 


Thafs looking great! I knew you could do it. 
now all I need is a way to add a new timing 
value directly from my phone. That would 
be awesome! 



丁 he s app 

V~Uhhih0 oh the 
s pKohC. 


Welcome to the future! 

You’ve delivered a solution that automates interaction with your website while 
providing a modern interface on an Android phone. Your app allows your 


O 


users to access web data directly on their mobile device. 


The fact that your server code runs on Python 3 and your Android client code 
runs on Python 2 makes very little difference: it’s all just Python code, after all. 

All that’s left to do is write some code to satisfy Coach Kelly’s latest request, 
and you’ll get to that in the next chapter. 

This is great work. 
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Your Pythow Toolbox 

You’ve got Chapter 8 under your 
belt and you’ve added some key 
Python techiques to your toolbox. 




BULLET POINTS 


The j son library module lets you 
convert Python’s built-in types to the text- 
based JSON data interchange format. 

■ Use j son • dumps () to create a 
stringed version of a Python type. 

■ Use j son. loads () to create a 
Python type from a JSON string. 

■ Data sent using JSON needs to 
have its Content-Type : set to 
application/json. 

■ The urllib and urllib2 library 
modules (both available in Python 2) 
can be used to send encoded data from 
a program to a web server (using the 

urlencode () and urlopen() 

functions). 

■ The sys module provides the sys. 

stdin, sys . stdout and sys . 
stderr input streams. 


CHAPTER 8 
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9 manage your d^ita 


參 Handling input ♦ 



The Web and your phone are not just great ways to display data. 

They are also great tools to for accepting input from your users. Of course, once your 
webapp accepts data, it needs to put it somewhere, and the choices you make when 
deciding what and where this “somewhere” is are often the difference between a webapp 
that’s easy to grow and extend and one that isn’t. In this chapter, you’ll extend your webapp 
to accept data from the Web (via a browser or from an Android phone), as well as look at 
and enhance your back-end data-management services. 


this is a new chapter 
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add data anywhere 


Your athlete times app has gone national 


We love what you 
did for Coach Kelly, but it 
would be great if we could 
add times for an athlete 
no matter where we are. Is 
this possible? 


O 



The National Underage Athletics Committee (JVUAC) took one look at your 
Android app and realized it’s just what they need.. .almost. 

There are many ways to improve your webapp, but for now, let’s concentrate 
on the committee’s most pressing need: adding a new time value to an existing 
athlete’s data set. 

Adding new data to text files isn’t going to work: there are just too many 
coaches around the country adding data. The committee wants something 
that’s user friendly from any web browser or Android phone. 


Can you help? 
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Use a form or dialog to accept input 



...or if you are on 
your phone, a call to 
the ” dialogGetInput ()〃 
function will do the trick. 


Simply use the standard 
<FORM> and <INPUT> tags 
within your HTML web page to 
get input from your users... 


On the Web, your user interacts with your web form and enters data. When 
she presses the submit button, the web browser gathers up all of the form’s 
data and sends it to the web server as part of the web request. 


On your Android phone, you can use the dialogGet Input () method to 
get input from the user, then mimic the behavior of the web form’s submit 
button in code. 

In fact, you’ve done this already: check out this line of code from your 
coachapp . py app, which sends the selected athlete name to your web 
server: 


WevVs whcvc the 

is ihdluded 
the web 



athlete = json•loads(send 一 to_server(web 一 server + get 一 data 一 cgi, {'which athlete ，： which athlete})) 
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form action 


Create aw HTML form template 

Let’s extend yate . py to support the creation of a HTML form. Take a look 
a this simple form, together with the HTML markup used to produce it. 


^ o ^ 

form.htm! 



► 

+ ' ^ http://local host : 8080 /form . htm 1 

C Google 



Apple Yahoo! Coogile Maps YouTube 

Wikipedia PopyfarT 




The cgi module converts the data associated with the web request into a 
dictionary-like object that you can then query to extract what you need. 
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Let’s turn the HTML form from the previous page into a template within the yate. py module. 

o Start by creating a new template called templates/form. html that allows you to 
parameterize the form’s CGI script name, method, input tags, and submit button text: 


❺ 


With the template ready, write the code for two functions you intend to add to yate. py. 

The first, called create—inputs () ， takes a list of one of more strings and creates HTML 〈 input 〉 tags 
for each string, similar to the one that accepts TimeValue on the previous page. 


The second, called do form() , uses the template from Part 1 of this exercise together with the create 


inputs () function to generate a HTML form. 




def create inputs (inputs list) : 



^•vch a list o-f <1_ 丁 > 
hdmes. 


RcWh the .y-v.... 

^aied tags -to <WP/7r ' f C ^' dhd a ,isi ^ 

ihc dallcy. return (html_mput ^)__^I > ^ 

def do_form(name, the—inputs, method="POST n , text= M Submit n ) : 

— — 、 '. 

Tk HTTP me 七 W a”d 七 c % 七 

. 丨七 , ’ V^avc 

dc-faul-b values. 

Sufes"t**bu*bc 七 he . 

av-auwcy\*U 

^cy\cv-a*bcd <INPWT> 

^^ return (form. substitute (cgi_name=name, http—method=method, 

■m. list of inputs=inputs, submit text=text)) 
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html form template 


You were to turn the HTML form into a template within the yate .py module. 

取 o You were to start by creating a new template called templates/form. html that allows you 
Qqi UjLI to parameterize the form’s CGI script name, method, input tags, and submit button text. 


c(\\ 咖 ? 七、 

assoti3*tcd 

HTTP me 七 W a 代 


<-fo\rm me*thod= 1 flvt*tp -- i^c*thod> 


Errtev a value ： flis^_o^_mpu*ts<b\r /> 

. ;; . :; … 二〒 - 

*tYpe =1 ”Submi*t” valuc= 1 fsubimi*t - _tc><. , t></-for 


The list o( <l/s/pUT> 
ahd the submit 

bui-fcohs texi is also 

pavdwteviicd. 



o 


With the template ready, you were to write the code for two functions to add to yate. py. 

The first, called create—inputs () ， takes a list of one of more strings and creates HTML 〈 input 〉 tags 
for each string, similar to the one that accepts TimeValue. 

The second, called do—f orm (), uses the template from Part 1 of this exercise together with the create— 
inputs () function to generate a HTML form: 


def create inputs (inputs list) : 


Take 灼 awe 

ay\d create 扣 

<|NPWT> ^ 


TWis UmuaW” 
tV)av-at*bcv- lc*b Y ou s ?l ’ 七 

a \o^ I'mc Code ovcv 
multiple 1 •… cs. 

i 


lvW_mpu*ts 二 ” 

-for m list 

h*W_mputs 二 html 一 inputs + *typc=- u Te%t w + 

cadh_mpu*t + l)， siz_c 二午 0>’ 

return(html_inputs) 

def do form(name, the inputs, method="POST n , text= M Submit n ) : 


^v-alo *bV\c 
W?1a 七 e 
youV" disk- 



Clrcatc d 
七 e -PoVi 


y/i*th opchO*tcinr\pla*tcs/3s -forrw-f ： 

二 -fo\rm-f.\rcadO 

•mpu*ts 二 d\rea*te_mpu*ts(*the_ihpu*ts) 

-form =■ 叶 la*te(*fo\rm 一七以七） 


C^re3ic the list cvf </A/PUT> -bgs. 


return(form.substitute(cgi_name=name, http_method=method, 

list of inputs=inputs, submit text=text)) 
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Tesr DriVq 


Here’s the code to a CGI script called cgi-bin/test-f orm. py, which generates the HTML form 
from earlier. As you can see, there’s nothing to it. 


#! /usr/local/bin/python3 


import yate 



Always stav-t with a 

V-cspohSC. 




print(yate•start—response('text/html')) 
print(yate.do_form('add_timing data.py', ['TimeValue'], text='Send')) 


Set the executable bit (if required on your OS) using chmod + x test_f orm . py , and then use 
your browser to confirm that your HTML form-generating code is working. 


URL U C^l ^ 

Woy/sc^s \otai\o^ ba^r. 


youv- 


矜 O G 


http^<^ca[host:8080/cgi-biin/test_fomi.py 


< 


+ 

h ； ttp://localhosi ： e0S0/cgi-bin/test_form,pv C 


□P 5555 Apple Yahoo! Google Maps YouTube Wikipedia Popytar 1 


Enter a timing value: 

:• Submit J 


youir bvowscv- ； s 

optioh -to -that 

the is 

exactly what yo“ heed. 


J hc 5 c ^icd HTML 
•Pow appear wi-thih 
the birowsev's wihdow. 


Source of http://localhost:80S0/cgi-birt /test form.py 


■d 1 orm action="cgi-bin/add_timing_data.py" method="P05T l 
Enter a timing value: 

〈input type="Text" name= 11 TimeValue" size=40> 

<br /> 

〈input type="Submit" value="Send"> 

Vform> 


A 


Great. You’ve extended yate . py to support the creation of a simple data 
entry form. Now all you need to do is to decide what happens once the data 
arrives on your server. 
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data delivery 


The data is delivered to your CW script 


In addition to running your webapp, the web server also arranges to deliver 
any submitted form data to your waiting CGI script. Python’s cgi library 
converts the data into a dictionary and, as you already know, provides you 
with convenient access to the submitted data: 


import cgi 


form = cgi.Fieldstorage() 





A"youv *fovm’s 
t as tcch added -to the 
cktiohavy. 


Additional information about the web request is also available to you via the 
web server’s environment. Typically, you won’t need to access or use this data 
directly. However, occasionally, it can be useful to report on some of it. 

Here is some code that takes advantage of Python’s built-in support for 
querying your CGI script’s environment using the os library, assuming the 
environment values have been set by a friendly web server. Note that the data 
in the enviroment is available to your code as a dictionary. 


import os 
import time 
import sys 



Be suve -to ihdude "the 

os liblrairy ih youv- lis-t of 
impoirts. 


addr = os.environ['REMOTE_ADDR'] 
host = os.environ['REMOTE_HOST'] 
method = os.environ['REQUEST METHOD'] 


cur time = time.asetime(time.localtime()) 


Pisplav . 

r cr\td data—^ print (host + - + addr 

oy\ 


+ cur time 


公叫 七 Wrcc vanablcs 

a^d ass\^ values -to vav»ablcs. 



the tim 


C. 


+ method, file=sys.stderr) 



CV-V-OV-. 


Let’s exploit both code snippets on this page to log the data sent from a form 
to your web server’s console. When you are convinced that the data is arriving 
at your web server intact, you can extend your code to store the received data 
in your model. 

Let’s write a CGI to display your form’s data. 
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CGI Magnets 



p 。 於’七 

W\\s Imc Y ou 
avc \ruy\y\m 5 oyv 
Ma^ OS )< ov 
L-mu%- 


TV^c’s vcally 

y\cv/ 

hcvc. 


You need a new CGI script called add—timing—data.py ， 
which processes the data from a form and displays the data on 
your web server’s console screen. The CGI needs to query the 
environment, arranging to display the logged data on one line. 
The code exists, but most of it is all over the floor. Rearrange the 
magnets to produce a working program. 



/ usr/local/bin/python3 


import cgi 
import os 
import time 
import sys 
import yate 


addr = os.environ['REMOTE_ADDR'] 
host = os•environ['REMOTE—HOST'] 
method = os.environ['REQUEST—METHOD'] 
cur_time = time.asctime(time.localtime()) 
print(host + n , " + addr + n , " + cur_time + 

end= ' 'f ile=sys . stderr) 


s ho 七 o^* 

ircspohsc -fov how...so 
just schd pbi h 

"to the wai-tihj 
web bvowsev-. 



+ method + 


print('OK.' 



form = cgi.Fieldstorage() 


print (each form item + + form [each_form__item] • value f 


print(file=sys•stderr) 
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add timing data 


CGI Magnets Solution 



You need a new CGI script called add_timing_data. py, 
which processes the data from a form and displays the data on 
your web server’s console screen. The CGI needs to query the 
environment, arranging to display the logged data on one line. 
The code exists, but most of it is all over the floor. You were to 
rearrange the magnets to produce a working program. 


#! /usr/local/bin/python3 


import cgi 
import os 
import time 
import sys 
import yate 


print(yate.start_response('text/plain ')) 
addr = os•environ['REMOTE—ADDR'] 
host = os•environ['REMOTE—HOST'] 
method = os.environ[* REQUEST_METHOD'] 
cur_time = time.asctime(time.localtime()) 


print(host + n , " + addr + ", " + cur_time + 

end='', file=sys.stderr) 


+ method + 


form = cgi.Fieldstorage() 
for each form item in form.keys() : 


that 

-ruh^tioh docs HOT iakc c 
i^CwlihC. 


print (each 一 form 一 item + ' ->/ + form [each 一 form 一 item] .value ， 


end= 


print(file=sys.stderr) 

print('OK.') 


file=sys•stderr) 


lake a ov\ s*tay\d3v-d evvov. 
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Tesr DriVq 


Let's use your form-generating CGI script from earlier to try out add_timing_data . py. As you 
enter data in the form and press the Send button, watch what happens on the web server’s console. 


BOO 


httpL//loca[host: 8080 /cgi-biin/test_forim.py 


some 

data m*bo youv 
v/eb -fov-w. 



► 

+ 

hitp7/Iocalhost:80S0/cgi-bin/tesi forfn.pv C 


CO 


Apple Yahoo! Cooglle Maps VouTube Wikipedia, PopufarT 


Enter a timing value: 2.22 

〔 Send) 




http://locafhost: 80 ft ?/cg i - bi n/add_t i m i ng_data.py 



hitp://localhosi:S08^^i-bin/adcl_timing_: C | ( Or Google 

PP :::: Apple Yahoo! Google VouTube Wikipedia Popufar 


The web bvowsev" 
displays a vevy 
bask vcspohsc. 

aii is w or. 



File Edit Window Help DisplayingPOSTs 


$ python3 simple—httpd.py 
Starting simple—httpd on port: 8080 

localhost - - [21/Sep/2010 17:34:54] "GET /cgi-bin/test_form.py HTTP/1.1" 200 - 
localhost - - [21/Sep/2010 17:34:54] "GET /favicon.ico HTTP/1.1” 200 - 
localhost - - [21/Sep/2010 17:35:24] "POST /cgi-bin/add_timing_data.py 
localhost, 127.0.0.1, Tue Sep 21 17:35:24 2010 : POST : TimeValue->2.22 


200 - 



TV>c v/clo scv-vcv s 

sdrcc 灼 

d'lsflays i\\t data 
七 V^a 七 avv-Wcd, as 一 
y/cII as i\\t 
asso^atedi 如仏••七 . 


That worked perfectly. The data entered into the form is delivered to your 
CGI script on the your server. Your next challenge is to provide the same user 
input experience on an Android phone. 
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android data entry 


Ask for input on your Android phone 


When you ask for user input on Android, the dialog that your user sees looks 
something like this example, which asks your user to confirm or change the 
web address and port for your server. 



http: 〃 192 . 16 SI 33 ;S 030 


© Which server should I use? 


SG][2jPa w 也 rr„_ 


11:03 PM 


Muetooth chat. 


Please confirm the server 
addnesyname to use for your 
athlete's timing data: 


Ah ll 0^ buttoh 〆 
^oh-fiv-r^s -the Chivy. 


TV mfu-t dialo^as 

a title- 


The\re’s some 
additional des^rip 七 We 
七以七 (ov message)- 


A -Pov data 
⑼ "bry, whch "tapped, 
birihg ups the (Wf 

keyboard. 


cancel 


H /\ TaMcl” 

lc*U you Aa 呼 Y ouV 
wmd- 




- i-d 


A single Android call creates this interface for you using the 
dialogGetlnput () method: 


title = 'Which server should I use?' 

message = "Please confirm the server address/name to use for your athlete's timing data : 
data = 'http://192.168.1.33:8080' 

resp = app.dialogGetlnput(title , message , data).result 


Pressing the Ok button sets resp to the data entered into the input area. 


Pressing the Cancel button sets resp to None, which is Python’s internal 
null-value. 



TV vcsul-t o( youv 
use’s ihtc^fi-tioh 
with ihc dialog is 
assighed -to Vcsp w . 


Let’s create some Android data-entry dialogs. 
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9 ^. 




Let’s create a small Android app that interacts with your user twice. The first dialog asks the 
user to confirm the web address and port to use for the web server. Assuming your user taps 
the OK button on your dialog, a second dialog pops up to request the timing value to send to the 
server. As with the first dialog, tapping the OK button continues execution by sending the newly 
acquired timing value to the web server. Tapping Cancel at any time causes your app to exit. 

Some of the code is provided for you. Your job is to complete the program. Write the code you 
think you need under this code, and call your program get2inputsapp.py: 


reeves 

sccy\ ail o-f 
七 Wis todc 
fec-fovc- 



import android 

from urllib import urlencode 

from urllib2 import urlopen 


server_title 
server—msg 
timing—title 
timing—msg 
web server 


'Which server should 工 use? 7, 

"Please confirm the server address/name to use for your athlete's timing data : 
'Enter data' 

'Provide a new timing value:' 


http://192.168.1.33:8080' 

/ cgi-bin/add timing data.py' 


app = android.Android() 


def send 一 to_server(url, post 一 data=None): 
if post_data : 



page = urlopen(url, urlencode(post 一 data)) 
else : 

page = urlopen(url) 
return(page.read().decode("utf8")) 
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user interaction 


EjceRctSe 
SoLuiloH 


You were to create a small Android app that interacts with your user twice. The first dialog asks 
the user to confirm the web address and port to use for the web server. Assuming your user taps 
the OK button on your dialog, a second dialog pops up to request the timing value to send to the 
server. As with the first dialog, tapping the OK button continues execution by sending the newly 
acquired timing value to the web server. Tapping Cancel at any time causes your app to exit. 

Some of the code was provided for you. Your job was to complete the program by writing the 
code you think you need under this code and call your program get2inputsapp .py. 


import android 

from urllib import urlencode 
from urllib2 import urlopen 


server 一 title = 'Which server should 工 use?' 

server—msg = "Please confirm the server address/name to use for your athlete's timing data : 

timing—title = 'Enter data' 

timing—msg = 'Provide a new timing value:' 

web—server = 'http://192.168.1.33:8080' 
add_time_cgi = ' / cgi-bin/add_timing_data.py' 

app = android.Android() 


def send 一 to_server(url, post 一 data=None): 
if post_data : 

page = urlopen (url, urlencode(post 一 data)) 
else : 

page = urlopen(url) 
return(page.read().decode("utf8")) 


The -piirst dialog asks y 。 ⑽ 

usc,r ^ -the web 

addv«s a^d povt io use. 



resp 二 app.dialog 今 etlnpu 七 (server 一 server 一 ms 少 web 一 server).\resul 七 


. 7 ouv- us^ a»a NOT ta? 

^ Ca ^' UtW " ■- ^ dialog asks 4, 

web 一 server 二 resp a hC>w v ^luc. 

i-f vesp is r\o*t Moy\C : (^： _ _ i-f yo\AV usev- did NOT 

. , . -tap Cartel W 七 … ../the app s C hds the 

-to the web s^v^. 

schd_-to_sc\rvc\r(y/cb_sc\rvc\r + add 一七 ime—dgi, { 1 Tim*m5\/aluc ， ： 
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Tqst DriVQ 


Let’s copy get2inputsapp . py to the emulator using the adb tool: 


tools/adb push get2inputsapp.py /sdcard/sl4a/scripts 


The get2inputsapp . py app appears on the list of scripts within SL4A. Go ahead and give it a tap: 



SSS4 drc>id2.2 



扒 y o<a 乙 l' 1 乙 k 
OY\ 七 ^ 

avea, /Wr。 1 心 

keyboavd 

pops u\>. 


Mcr a y\c^j 

value ， 

av\d *tV^ *tap 


/ou^r ^ ^ 

3ir\d ed' 1 七 

i\\c >/c1d SCVVCV 

addv-css ay\d \>ov • 七 . 


刚幻 6:25 叫 


^ Which server should I use? 


Please confirm the server 
address/name to use for your 
athlete's timing data: 




SSS4 drcMd2.2 


I http://192.168.1.33:8080| 


8:50 pm 


(j) Enter data 

Provide a new timing value 


C-'-lCr 


紅 T 


5YM 


m III u lillMUXIililiiMM I IIiMIiIiIIH I UilnF 
$ python3 simple—httpd.py 

Starting simple—httpd on port: 8080 

localhost - - [21/Sep/2010 17:34:54] "GET /cgi-bin/test_form.py HTTP/1.1" 200 - 

localhost - - [21/Sep/2010 17:34:54] "GET /favicon.ico HTTP/1.1" 200 - 

localhost - - [21/Sep/2010 17:35:24] "POST /cgi-bin/add_timing_data.py HTTP/1.1" 200 - 

localhost, 127.0.0.1, Tue Sep 21 17:35:24 2010 : POST : TimeValue->2.22 

192.168.1.33 - - [21/Sep/2010 20:50:30] "POST /cgi-bin/add_timing_data.py HTTP/1.1" 200 - 
localhost, 192.168.1.33, Tue Sep 21 20:50:30 2010 : POST : TimingValue->2 : 56 



T*hc web scirvcv^ 
log doh-Pivms 
the dais wds 


s ^ivt -Plrom 
Cmula*fco\r. 


youv- 


Perfect. That’s working, too. Regardless of where your data originates —— on 
the Web or a phone — your app can send it to your web server. 
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update which c/afasef? 


Ifs time to update your server data 



yikes! I think there's a problem here... 
your server data is in two places ： within 
your pickle and in the NUACs text files. 
The question is ： which one do you update? 


Which of your two datasets should you update? 


If you update the pickle, the next time the put—to—store () 
function runs, your most recent update will vanish as put_ 
to_store () recreates the pickle from the data in the text files. 
That’s not good. 


If you update the appropriate athlete’s text file, the data in the 
pickle will be stale until put_to_store () runs again. If 
another process calls the get_f rom_store () function in the 
meantime, the update to the pickle might not have been applied 
and will appear to be missing for anyone reading your data. That’s 
not good, either. 


Oh, look, how lovely ： I 
have a new timing value to add to 
the system. Who’s going first? 




Vouir text -file 


^ Youv ftklc Wc 
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Avoid race conditions 


o 

o 



Of course...I could 
write to the text file 
and then immediately call 
'put_to_store() /, to update 
the pickle, right? 


Yes, that’s one possible solution, but it’s a poor one. 

You might think it highly unlikely.. .but it is possible for another 
process to call the get_f rom_store () function between the text file 
update and the pickle recreation, resulting in a short period of data 
inconsistency. These types of situations are known as race conditions 
and are hard to debug when they occur. 

It’s best to keep them from ever happening if you can. 

The basic problem here is that you have one update with one piece of data 
that results in two file interactions. If nothing else, that’s just wasteful. 




0 


Vouv- up--fco- ^ 

date "tcx-fc -file 



t Youv 

㈣ 1c Wc 
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avoid race conditions 


You need a better data storage mechanism 

Your initial text files and pickle design is fine when only one user is accessing 
the data. However, now that more than one person can access the data at any 
time, and from anywhere, your design is in need of improvement. Above all, 
you need to avoid that race condition. 



Youv- mtcwsis 七 cyv 七 
dy\d u\>sc*t f'ltklc -flic 


Listen, bud, it’s not my fault...until 
someone, somewhere runs the 、、 put—to 」 tore ()〃 
function without someone, somewhere else running the 
'get_from_store() /, function, you’ll have to do without that 
data update. I*m not a miracle worker...I just do what 
I’m told. 


O 



tKeretare no ^ 

Dumb Questi9ns 


Surely you should have thought about this problem long 
ago and designed this "properly” from the start? 

That’s certainly one way to look at things, and hindsight is 
always a wonderful thing! However, programs have a tendency 
to start out small, then grow to provide more features, which can 
introduce complexity. Recall that the coach’s app started life as a 
simple “standalone” text-based program, which was then moved 
to the Web to support multiple users. Part of the app was then 
redeveloped for use on an Android phone. And yes, if we’d known all 
of this ahead of time, we might have been designed it differently. 


So I’m facing a rewrite of large chunks of my code? 

Let’s see. You did build your program using the MVC pattern, 
and you are using Python, so those two facts should take the sting 
out of any potential rewrite, assuming a rewrite is what’s required 
here. 
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Wouldn t it be dreamy if I could put my 
data in only one place and support all my 
app*s requirements? But I know it's just a 
fantasy... 
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which database management system? 


Use a database management system 

You need to move away from your text file and pickle combination and use a 
real database management system. You have plenty of choices here... 




If you want rock- 
solid without the 
corporate bloat, it has 
to be PostgreSQL. 


MS SQL Server is 
used everywhere! 


I really like 
MySQL and 
MariaDB. 


All of these fine technologies will work, but they are overkill for your app’s 
data requirements. And besides some of these are way beyond the NUAC’s 
budget, let alone their ability to set up, run, and maintain such a system. 

What you need is something that’s effectively hidden from the NUAC yet lets 
you take advantage of what a database management system has to offer. 

If only such a technology existed... 
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Pythow includes SQLite 


Python 3 comes preinstalled with Release 3 of SQLite, a full-featured, zero- 
config, SQL-based data management system. 

To use SQLite, simply import the sqlite3 library and use Python’s 
standardized database API to program it.There’s really nothing to it: no 
database setup, no config, and no ongoing maintenance. 


With your data stored in SQLite, rewrite your webapp’s model code to use 
SQL to access, manipulate, and query your data. You can plan to move 
to one of the bigger database systems if and when your application needs 
dictate such a move. 


腎 , SQLite 


SQLite sounds perfect for the NUAC’s data, doesn’t it? 



6ee} B!fS 



1 CNo 

(\ 00 ( 

^ - 


Chloic /W’laWc 

y>od kooks av-c sold {p a 呼 me …七“ 


/al'id tavd.3 


The material in this chapter assumes 
you are comfortable with SQL 
database technology. If you are 
new to SQL (or just need a quick 
refresher), take a look at Head 
First SQL, which comes highly 
recommended. 


t 
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database connection process 


Exploit Python's database API 

The Python Database API provides a standard mechanism for 
programming a wide variery of database management systems, including 
SQLite. The process you follow in your code is the same regardless of which 
back-end database you’re using. 





Connect 

Establish a connection to your 
chosen database back end. 



Create 

Create a cursor to communicate through the 
connecton to your data. 



Interact 

Using the cursor, manipulate your 
data using SQL. 




Commit 

Tell your connection to apply 
all of your SQL manipulations 
to your data and make them 
permanent. 



Rollback 

Tell your connection to abort your 
SQL manipulations, returning your 
data to the state it was in before your 
interactions started. 




Close 

Destroy the connection to the 
database back end. 


灼， 7 ou，r 

\s dtsbro^tA, *too. 
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The database API as Pythow code 

Here’s how to implement an interaction with a database using the sqlite3 
module: 


T his disk is used io hold 
the da-bbasc 5h d its i^blcs. 



/\s alv/ays, 七 
1'iWa^Y you 
y\ccd- 


Establish a doirmed 七 10 灼 
-to a daiabdse- 



Cv-caic a duvsov- -to 
七 he data. 


import sqlite3 


connection = sqlite3.connect(▼test.sqlite ， 


cursor = connection.cursor() 


>m cursor • execute (▼▼▼▼ ▼▼ SELECT DATE (' NOW 丨 ） ▼▼” ”) 

Comrwi-t any _w 

r^aki^ -them pc^^^l~^ connection - commit () 


Close youir ^OhhC^tioh.^ 
whch youVc -fihished. 〆 L- 


connection.close() 



Depending on what happens during the Interact phase of the process, you 
either make any changes to your data permanent (commit) or decide to 
abort your changes (rollback). 

You can include code like this in your program. It is also possible to interact 
with you SQLite data from within IDLE’s shell. Whichever option you choose, 
you are interacting with your database using Python. 

It’s great that you can use a database to hold your data. But what schema 
should you use? Should you use one table, or do you need more? What data 
items go where? How will you design your database? 


Let’s start working on the answers to these questions. 
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design your database 


A little database design goes a long way 

Let’s consider how the NUAC 5 s data is currently stored within your pickle. 

Each athlete’s data is an AthleteList object instance, which is associated 
with the athlete’s name in a dictionary. The entire dictionary is pickled. 






Each AthleteList has the following attributes: 






With this arrangement, it is pretty obvious which name, date of birth, and list 
of times is associated with which individual athlete. But how do you model 
these relationships within a SQL-compliant database system like SQLite? 


You need to define your schema and create some tables. 
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Pcfiwc your database schema 

Here is a suggested SQL schema for the NUAC’s data. The database is called 
coachdata . sqlite, and it has two related tables. 

The first table, called athletes, contains rows of data with a unique 
ID value, the athlete’s name, and a date-of-birth. The second table, called 
timing—data, contains rows of data with an athlete’s unique ID and the 
actual time value. 



should make it easy io 
Uhi^uchcss. 


CREATE TABLE athletes 


id INTEGER PRIMARY KEY AUTO INCREMENT UNIQUE NOT NULL, 
name TEXT NOT NULL, 
dob DATE NOT NULL ) 


CREATE TABLE timing 一 data ( 

athlete 一 id INTEGER NOT NULL, 
value TEXT NOT NULL, 

FOREIGN KEY (athlete id) REFERENCES athletes) 



Ko-tc V^oy/ *bWis stWa w lmks’U>wo 



There can be one and only one row of data for each athlete in the athletes 
table. For each athlete, the value of id is guaranteed to be unique, which 
ensures that two (or more) athletes with the same name are kept separate 
within the system, because that have different ID values. 

Within the timing_data table, each athlete can have any number of time 
values associated with their unique athlete—id，with an individual row of 
data for each recorded time. 


Let’s look at some sample data. 
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athletes and values 


What does the data look like? 

If the two tables were created and then populated with the data from the 
NUAC’s text files, the data in the tables might look something like this. 



name 

James Lee 
Sarah Sweeney 
Vera Vi 
Julie Jones 
Sally Sanchez 
Mikey McManus 


d3t3 \oy athlete. 


dob 

2002 - 03-14 
2002 - 06-17 
2002*1 2 m 25 
2002 - 08-17 
2002 - 11-24 
2002 - 02-24 


If you create these two tables then arrange for your data to be inserted into 
them, the NUAC’s data would be in a format that should make it easier to 
work with. 

Looking at the tables, it is easy to see how to add a new timing value for an 
athlete. Simply add another row of data to the timing_data table. 

Need to add an athlete? Add a row of data to the athletes table. 

Want to know the fastest time? Extract the smallest value from the 
timing_data table’s value column? 

Let’s create and populate these database tables. 
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Thcvc’s wo\rc data m 七 Wis 
-table i\\av\ sV^ovm hevc. 



TV^'is is 4a 七七 he da*ta m i\\t 

tabic — 七 

look like, ^ —I 七』 

of data -fo\r tat\\ 

o^t voy/ tacM W” 
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SQLite Magnets 



Let’s create a small Python program that creates the coachdata . 
sqlite database with the empty athletes and timing data 


tables. Call your program createDBtables . py.The code you 
need is almost ready. Rearrange the magnets at the bottom of the 
page to complete it. 


import sqlite3 


cursor.execute("""CREATE TABLE athletes ( 


athlete_id INTEGER NOT NULL, 
value TEXT NOT NULL, 

FOREIGN KEY (athlete_id) REFERENCES athletes) nnn ) 

connection.commit() 
connection.close() 
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create database tables 


SQLite Magnets Solution 


Your job was to create a small Python program that creates the 
coachdata . sqlite database with the empty athletes 
and timing data tables. You were to call your program 



createDBtables . py. The code you needed was almost ready, 
and you were to rearrange the magnets at the bottom of the page to 
complete it. 


import sqlite3 





connection = sqlite3.connect( ' coachdata.sqlite ') 



cursor = connection.cursor() 


cursor.execute("""CREATE TABLE athletes ( 





athlete_id INTEGER NOT NULL, 
value TEXT NOT NULL, 

FOREIGN KEY (athlete_id) REFERENCES athletes) nnn ) 



connection.commit() 
connection.close() 


TV dommii iWt always ^ 
da-bbasc sysic 

is with 


^uiv-cd with 
but it 
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Transfer the data from your pickle to SQLite 

As well as writing the code to create the tables that you need, you also need 
to arrange to transfer the data from your existing model (your text files and 
pickle combination) to your new database model. Let’s write some code to do 
that, too. 

You can add data to an existing table with the SQL INSERT statement. 
Assuming you have data in variables called name and dob, use code like this to 
add a new row of data to the athletes table: 



TV daia \v\ these vaHables 
is ^bsii-tutcd i h ? \ au ^ 
仏 e pl^chold< 


levs. 


auWa-b^allY* 



BaK 会 

■V 

¥ 9 *HPH Cp\>q 


Here’s a program, called initDBathletes .py, which takes 
your athlete data from your existing model and loads it into your 
newly created SQLite database. 


import sqlite3 


{p 七 he y\C^i 

da*tabasc. '^connection 


^a\> -the 
dsis -fvom 
"the cxis-tihg 
^odcl. \ 


七七 he a*tV)lc*bc s 
y\drv\C POB 
-(•vow' *tV>c ^itkicd ，- ^ 

ddid- ^ ^ dob 


sqlite3.connect('coachdata.sqlite') 


cursor = connection.cursor () 

import glob 
import athletemodel 

data—files = glob.glob( M ../data/*.txt M ) 
athletes = athletemodel•put—to 一 store(data files) 

for each ath in athletes : 


name 


Wsc -the ll^/SBRT- 
siatemch-t -to add 
a hew irow -to ihc 

^ihlcics' -bblc. 


=athletes[each_ath].name 
athletes[each ath].dob 


‘cursor .execute ("INSERT INTO athletes (name, dob) VALUES (?, ?)' (name, dob)) 
connection.commit() 


々 lake the 匕 hahge(s) 


connection.close () 
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names and numbers 


What II? is assigned to which athlete? 


You need to query the data in your database table to work out which ID value 
is automatically assigned to an athlete. 


With SQL, the SELECT statement is the query king. Here’s a small snippet of 
code to show you how to use it with Python, assuming the name and dob 
variables have values: 


^ planholders \y,d\Uit 
wheve -the daia values 

substitute! ihio ihc 'U 饮 y. 


cursor.execute( n SELECT id from athletes WHERE name=? AND dob=? n , (name, dob)) 




If the query succeeds and returns data, it gets added to your cursor. You can 
call a number of methods on your cursor to access the results: 

• cursor . fetchone () returns the next row of data. 、 

• cursor . fetchmany () returns multiple rows of data, r 々 

• cursor . fetchall () returns all of the data. ) 


^csc tuvsov 
wc 七 Ws \rc*bu\nr\ a 

oH： V-OY/S. 


Names alone are not enough 
anymore...if you want to uniquely 
identify your athletes, I need to 
know their IDs. 


o 



Web 

Server 


i 
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Iwscrt your timing data 

You’re on a roll, so let’s keep coding for now and produce the code to take 
an athlete’s timing values out of the pickle and add them to your database. 
Specifically, you’ll want to arrange to add a new row of data to the 
timing_data table for each time value that is associated with each athlete 
in your pickle. 

Those friendly coders over at the Head First Code Review Team have just 
announced they’ve added a clean—data attribute to your AthleteList 
class. When you access clean—data, you get back a list of timing values 
that are sanitized, sorted, and free from duplicates.The Head First Code 
Review Team has excellent timing; that attribute should come in handy with 
your current coding efforts. 


^Iiarpen your pencil_ 

Grab your pencil and write the lines of code needed to query the 
athletes table for an athlete’s name and DOB, assigning the 
result to a variable called the—current—id. Write another 
query to extract the athlete’s times from the pickle and add them 
to the timing_data table. 

assi^cd b> 七一 . 

^ . 



ables e/is 七 have values 


vav-i 
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database queries 

^ Sharpen your pencil 

Solution 



巧七 ^ w at ^七 cs 

-table -fov- {\\t IP- ’ 


You were to grab your pencil and write the lines of code needed 
to query the athletes table for an athlete’s name and DOB, 
assigning the result to a variable called the—current_id. You 
were then to write another query to extract the athlete’s times 
from the pickle and add them to the timing data table. 




du\rso\r c>cedu*tc( w SELECT id -from athletes 1 /VttERE AND 


RcwcwIdcv: 
W -fc*tC>V>Oir\c0 ， 
VC*bvAV"ir\S d l>S*b* 

Take caA of 
七 w tlcay\ 

七 •iwcs a 灼 d use 
rb, -toybV\cv 

IP) 

v/rtWm 七 V\C 
S《L W I_T” 

s*ta 七灼七 . 


dob)) 



^ schsc 

youir execute 
s-ta-tcmcht ovcv- multiple 


lihes 


■the duvverrt id 二 Cursor.-frt^hohcOCO] 

— ― 7TT.... 

-for eddh *time m a*thlc*tcsCeadh a*th3 data: 

du\rso\r cx.cdu*tc^ w INSERT INTO (a*Wrte 」 d, value) W\LWES (?，？)' 

(■the durrerrt id, eddh *time)) 

Add ihc It) a^d ihc time 

value to the u timi h a 
daia }, ^bl c . 




As alv/ays, 七 W 惫 

doh^cd*tioh.dor«nr\i*tO C 一 Aay^C(s) 产 vwd 朽 cv\*b. 





Add the code to your initDBathletes .py code from earlier, 
just after the connection . commit () call. Rename your 
program initDBtables . py, now that both the athletes 
and timing—data tables are populated with data by a single 
program. 


That’s enough coding (for now). Let’s transfer your pickled data. 
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Tesr DriVq 


You’ve got two programs to run now: createDBtables . py creates an empty database, defining 
the two tables, and initDBtables . py extracts the data from your pickle and populates the tables. 
Rather than running these programs within IDLE, let’s use the Python command-line tool instead. 

Y/rth "tWis*- 

对 ’. 


Be 乙 aaful 

"to v-uh both 


I File Edit Window Help PopulateTheTables | 


$ python3 createDBtables.py 
$ python3 initDBtables.py 



y 。 认⑽ \ruvmm 》 

\rcplatc 


pirogirams OHLY 

oh 匕 e. 





Hello? Something happened there, 
didn’t it? I ran the programs but nothing 
appeared on screen...how do I know if 
anything worked? 
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sqlite manager 


SQLite data management tools 


When it comes to checking if your manipulations of the data in your 
database worked, you have a number of options: 



Write more code to check that the database is in the 
state that you expect it. 

Which can certainly work, but is error-prone, tedious, and way too 
much work. 


Li-Pc ircally is 
"too shov-fc. 




Use the supplied %% sqlite3 #, command-line tool. TMt、a ^\od, 

Simply type sqlite3 within a terminal window to enter the SQLite 
“shell.” To find out which commands are available to you, type . help 
and start reading. The tool is a little basic (and cryptic), but it works. 


-folloY/cd W inc 

VI? 



Use a graphical database browser. 


There are lots of these; just Google “sqlite database browser” for 
more choices than you have time to review. Our favorite is the SQLite 
TWis is v/ha 七 Manager, which installs into the Firefox web browser as an extension. 

七 c Ma^ayv- 

looks like- 



- but Ohly oh 

Fiirc-Pox. 


(R O O 


SQLite Manager - /Users/barryp/HeadFirstFVthon/chapterO/coachdata.sqSite 






哆 fix) 




madi data, sqlite 


Master Table [1J 
Tables (3> 
alhlctcs 
sqlite_sequence 
ti min g_data 
Views (0) 

Indexes 
Triggers (0) 


Directory 


ESeliect Profile Database) : Co 


T 1 


TABLE athletes 


Structure 0rowse & Search Execute SQL DB Settrngs 


Search 


4 

id 

name 

dob 


I 

James Lee 

2002-3-14 


2 

Sarah Sweeney 

2002-6-17 

>i 

3 

Vera Vi 

2002-12-25 


4 

Julie Jones 

2002-8-17 


S 

Sally Sanchez 

2002-11-24 

4 

6 

Mi key McManus 

2002-2-24 


〔 Show All 〕〔 Add .) 〔 Duplicate 〕 


SQL]le 3,6n22 Gecko 1,9.2.10 :: :'.6‘1 Exclusive Number of files in selected directory: 10 



Edit 


ET: 


A 


—aU oUhe 槪 H 士 / 細 . 


But how do you integrate your new database into your webapp? 
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Integrate SQLite with your existing webapp 



Joe: This should be easy. We just have to rewrite the code in 
athletemode 1. py to use the database, while keeping the API the 
same. 

Frank: What do you mean by keeping the API the same? 

Joe: Well.. .take the get_f rom_store () function, for instance. It 
returns an AthleteList dictionary, so we need to make sure that 
when we update get_from—store () to use our database that it 
continues to return a dictionary, just as it’s always done. 

Frank: Ah, now I get it: we can query the database, grab all the data, 
turn it into a big dictionary containing all of our AthleteList 
objects and then return that to the caller, right? 

Joe: Yes, exactly! And the best of it is that the calling code doesn’t need 
to change at all. Don’t you just love the beauty of MVC? 

Frank: Ummm...I guess so. 

Jim: [cough, cough] 

Frank: What’s up, Jim? 

Jim: Are you guys crazy? 

Joe & Frank: What?!? 

Jim: You are bending over backward to maintain compatibility with an 
API that exists only because of the way your data model was initially 
designed. Now that you’ve reimplemented how your data is stored in 
your model, you need to consider if you need to change your API, too. 

Joe & Frank: Change our API? Are you crazy?!? 

Jim: No, not crazy, just pragmatic. If we can simplify the API by 
redesigning it to better fit with our database, then we should. 

Joe: OK, but we haven’t got all day, y’know. 

Jim: Don’t worry: it’ll be worth the effort. 


you are here ► 


327 


get out of a pickle 



JtPH 容 ExeRciSe 


Let’s spend some time amending your model code to use your SQLite database as opposed 
to your pickle. Start with the code to your athletemodel. py module. Take a pencil and 
strike out the lines of code you no longer need. 


import pickle 

from athletelist import AthleteList 

def get_coach—data(filename): 
try : 

with open(filename) as f : 

data = f.readline() 
tempi = data.strip().split ) 

return(AthleteList(tempi.pop(0) f tempi•pop(0), tempi)) 
except 工 OError as ioerr : 

print('File error (get_coach—data): * + str(ioerr)) 

return (None) 

def put_to_store(files—list): 
all—athletes = {} 
for each—file in files 一 list: 

ath = get_coach—data(each—file) 
all_athletes[ath.name] = ath 

try : 

with open( 1 athletes.pickle ', 'wb') as athf : 


pickle.dump(all—athletes, athf) 


except 工 OError as ioerr : 


print('File error (put—and—store): * + str(ioerr)) 

return (all athletes) 
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def get—from_store(): 
all—athletes = {} 
try : 

with open ( 1 athletes .pickle ** rb ' ) as athf : 
all—athletes = pickle.load(athf) 
except 工 OError as ioerr : 

print('File error (get_from_store) : ' + str(ioerr)) 

return(all—athletes) 


def get_names—from_store(): 

athletes = get—from_store() 

response = [athletes[each—ath]•name for each—ath in athletes] 
return(response) 
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out of a pickle 



裏 oh 容 Exercise 
SoLytioH 


Let’s spend some time amending your model code to use your SQLite database as opposed 
to your pickle. Start with the code to your athletemodel. py module. You were to take a 
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got_from_otorGf-) : 

all_ath1oto? - __ W- 

try :. 

wi th n yn (' 对 h 1 一和 、 j i 1 1 ' 1 "'"7 1 ) ~~6-S««»th£ : 

-all_athlGtco — pickle . load(athf ) 

exceptlui^rror as ~~ loerr : 

t — print ('File ei iui ~~~ _f i on m_°^ • ' + .qf f (j n^r-r-VJi. 

rSl^urn (d .11 ― 3 ~L 1 丄 It!Lub) - 


elef-get_name3_f i°om_otorG () ; 



^ at-hletco rom_Gtoro ( ) 


xocponoc — [athletes [GQch_a 4 :h] . nanTCror each_aLli TTT~S"Llllt!ltC 04 


-r^~h 11 ~rn ( ~r^ Q p or lS G ) 
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get names from store 


You still need the list of names 

Throwing away all of your “old” model code makes sense, but you still need 
to generate a list of names from the model. Your decision to use SQLite is 
about to pay off: all you need is a simple SQL SELECT statement. 




k 鄉 9 Baw 

him Cope 


Here's the code for your new get_names_from_store () 

function: 


Cohhc^t -to the 

debase. 


ddid Y ou 


Fov-mulatc a 

VCSpohSC. 



import sqlite3 

db_name = 'coachdata.sqlite' 

def get_names_from store () : 

connection = sqlite3.connect(db_name) 
cursor = connection.cursor () 

results = cursor.execute("""SELECT name FROM athletes""") 
response = [row[0] for row in results.fetchall ()] 
connection.close () 
return (response) 


yvarwCS *bo ulld 


I guess in this case it 
actually makes perfect 
sense to maintain the 
API for this call. 
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fret aw athlete's details based on II? 

In addition to the list of names, you need to be able to extract an athlete’s 
details from the athletes table based on ID. 



|_| ere ' s coc j e f or an other new function called 

htm get_athlete_from_id() : 


^c*U da*ta ( 

associated 如从 

a IP* 

"the “hame" 
ahd values' 

-fv-om -the a-thlctcs 
table. 

6\t{, *tV^c o-f_^ 

*tirv\CS "(Vow 七 ViC / 

W *tiw^y\5u— data 

-tabic- 



l^oic -the use Jc the pld^holde 
fmdi 冰 wh^c the ^ihlcie 

' d is ihsev-ted ih-to 

the 綠 SELECT ^y. 

results = cursor.execute ("""SELECT name, dob FROM athletes WHERE id=? nnn . 


def get—athlete—from—id(athlete id) : 

connection = sqlite3.connect(db name) 
cursor = connection.cursor () 


(athlete id,)) 



Rctuv-h -fchc 
athlete’s daia 
"b> the taWcY-. 


(name, dob) = results.fetchone() 


results = cursor.execute( MM "SELECT value FROM timing—data WHERE athlete 


data = [row[0] for row in results.fetchall()] 



response 


'Name 
'DOB' 

'data 
'top3 


connection.close() 
return(response) 



ihc daia both 

^ uc 7a"d tua it ih^to 
a d"ui-tiohav-y. 


This function is a more involved than get_names_from—store () ， but 
not by much. It still follows the API used with working with data stored in 
SQLite. This is coming along, nicely. 

With the model code converted, you can revisit your CGI scripts to use your 
new model API. 


Let’s see what’s involved with converting the CGIs. 
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use ids internally 



Isn’t there a problem here? The 
、、 get_names—from—store ()〃 function returns a list 
of names, while the 、、 get—athlete—from—id ()〃 function 
expects to be provided with an ID. But how does the 
web browser or the phone know which ID to use when 
all it has to work with are the athletes* names? 


That’s a good point: which ID do you use? 

Your current CGIs all operate on the athlete name, not 
the ID. In order to ensure each athlete is unique, you 
designed your database schema to include a unique ID 
that allows for your system to properly identify two (or 
more) athletes with the same name, but at the moment, 
your model code doesn’t provide the ID value to either 
your web browser or your phone. 

One solution to this problem is to ensure that the athlete 
names are displayed to the user within the view, while the 
IDs are used internally by your system to unique identify 
a specific athlete. For this to work, you need to change 
get names from store (). 
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Here is the current code for your get—names—from—store () function. Rather than 
amending this code, create a new function, called get—names ID_from_store (), 
based on this code but including the ID values as well as the athlete names in its response. 
Write your new function in the space provided. 


import sqlite3 

db_name = 'coachdata.sqlite * 

def get_names 一 from—store(): 

connection = sqlite3•connect(db—name) 
cursor = connection.cursor() 

results = cursor.execute("""SELECT name FROM athletes""") 
response = [row[0] for row in results.fetchall()] 
connection.close() 
return(response) 
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get name’s id 


職 

ExeactSe 

Sotutvo 


Here is your current code for your get—names_f rom_store () function. Rather than 
amending this code, you were to create a new function, called get_namesID_f rom_ 
store (), based on this code but including the ID values as well as the athlete names in its 
response. You were to write your new function in the space provided. 


import sqlite3 


db—name = 'coachdata.sqlite 


def get_names 一 from_store(): 


connection = sqlite3.connect(db_name) 
cursor = connection.cursor() 

results = cursor.execute("""SELECT name FROM athletes 
response = [row[0] for row in results.fetchall()] 
connection.close() 


return(response) 


drf ^amesID -from s*to\rcO ： 


二 七 (db 一的如亡） 


*to ih^ludc the 
value of M id w lh 

“SELECT" c^y. 


Cursor ==■ dorme 匕 *tiohdu\rsovO 



results =■ du\rso\r.c%cdu*tc( uuu SELECT Y\^t, id FROM a*thlrtcs www ) 


response — results . 不 dha llO 

dorme 匕 *boh.doseO 






T\\trts> y\o v\tcA *to potess 

Vsults" m 呼 

^rcW^cd Wovr the 

<\UCV-Y *to \csyOY\St - 


， y 。 十 sc y 财 崎 is 

丄 : c ^ pti ° h ^ y° u 
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TV^'is is i\\t w y^c\ra*tO ,s ^?7 

I 辦七 . 

/ #! /usr/local/bin/python3 

import glob 
import athletemodel 
import yate 


Part 1 : With your model code ready, let’s revisit each of your 
CGI scripts to change them to support your new model. At the 
moment, all of your code assumes that a list of athlete names or an 
AthleteList is returned from your model. Grab your pencil and 
amend each CGI to work with athlete IDs where necessary. 


data—files = glob.glob("data/*.txt") 

athletes = athletemodel.put—to_store(data—files) 


print (yate.start response()) 




print(yate.include 一 header("NUAC's List of Athletes")) 
print(yate.start—form("generate 一 timing 一 data.py")) 

print(yate.para("Select an athlete from the list to work with:")) 


Wote ihc dhahac -to 

"the title. 


for each—athlete in sorted(athletes) : 

print(yate.radio 一 button("which—athlete ”， athletes[each—athlete].name)) 
print(yate.end_form("Select")) 

print(yate.include 一 footer({"Home" : " / index.html"})) 


TV^is is. 

I #! /usr/local/bin/python3 

import cgi 

import athletemodel 

import yate 


TWls is ^Oh-tihucd 

咖 the hex-t page, bui ho 

pcckihj/ J)oh t flip ovcv uh-til 

卜 —u 

this page. 


athletes = athletemodel.get—from—store() 
form 一 data = cgi.FieldStorage() 

athlete 一 name = form—data['which—athlete'].value 
print (yate . start 一 response () ) 

print(yate.include 一 header("NUAC 1 s Timing Data")) 

print(yate.header("Athlete : " + athlete—name + ", DOB : " + athletes[athlete—name].dob + 
print (yate.para ("The top times for this athlete are:")) 
print(yate.u 一 list(athletes[athlete 一 name].top3)) 

print(yate.para("The entire set of timing data is: " + str(athletes[athlete—name].clean_data) + 

"(duplicates removed).")) 

print(yate.include 一 footer({"Home": "/index.html", "Select another athlete" : "generate_list.py"})) 


you are here ► 
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not done yet 


貧 ^ ar, ien your pencil 



Part 2: You’re not done with that pencil just yet! In addition to 
amending the code to the CGIs that support your web browser’s 
Ul, you also need to change the CGIs that provide your webapp 
data to your Android app. Amend these CGIs, too. 


TWis is ,, 


C6\l 



#! /usr/local/bin/python3 


import j son 

import athletemodel 
import yate 

names = athletemodel.get—names—from 一 store() 

print (yate.start 一 response('application/json')) 
print(j son.dumps(sorted(names))) 


f[v\d V^cv-c is 

data.— 



#! /usr/local/bin/python3 

import cgi 
import j son 
import sys 

import athletemodel 
import yate 

athletes = athletemodel.get—from—store() 
form 一 data = cgi.FieldStorage() 

athlete 一 name = form—data['which—athlete'].value 

print(yate.start 一 response('application/json')) 
print(json.dumps(athletes[athlete 一 name].as_dict)) 
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/,、 Sharpen your pencil 

Solution 



TW«s *»s i\>t 七 cX 

I 辦七 . 

#! /usr/local/bin/python3 


Part 1: With your model code ready, you were to revisit each of 
your CGI scripts to change them to support your new model. At the 
moment, all of your code assumes that a list of athlete names or an 
AthleteList is returned from your model. You were to grab your 
pencil and amend each CGI to work with athlete IDs where necessary. 



import athletemodel 
import yate 


"this wov*k -rov* you 


athletes 


flo b - ( 上 da 

athletemodel. 




c*t storeO 

-i 1 o o \ 



print(yate.start—response ()) 

print(yate.include 一 header("NUAC's List of Athletes")) 
print(yate.start—form("generate 一 timing 一 data.py")) 

print(yate.para("Select an athlete from the list to work with:")) 
for each athlete in sorted(athletes) 

print(yat buttori^' which athlete" , 

print(yate.end—form("Select 
print(yate.include footer 


TV a 代 a 心七 f 

| 也 ， so 柹 c code *to 

a 七 4c data you 




eddh a*thlc*tcC03, a*thlc*tcCI3) 


TWis is 

#! /usr/local/bin/python3 

import cgi 
import athletemodel 
import yate 


({ "Home":) "/ 


/ index.html"})) 

radio butbo 灼 idO ?’？ 

t |七 looks like vou 一吵七 

a : Va 山 。一 

feurt 七 oW Wt«o^?!? 

七仏 e a-tV^lc-tc's data 
-fv-ow *bV^c model ， 
\rcW”s a d^Wa 矿沴 


this 以狀 W 

SolutlOh is Oh the hexi page. 


J 


form—data = cgi.FieldStorage() 

athlete—name = form—data['which—athlete 1 ].value 

a*thle*te 二 a*thlc*tc^odd oic*t a*thlc*tc -from id(a*thlrte id) 

print(yate.start—response ()) 

print (yate . include 一 header ("NUAC ' s Timing Data")) — a*thle*ter/Vai^e’] + w 

print (yate . header ( "Athlete : " + 


匕:士 dais 3s 

伽 , + ai^titCVOd^ 


print(yate.para("The top times for this athlete are:")) 
print (yate . u—list ( Cfe-1 afce— ) 


s*tr(a*th 1 rterda*ta’]) 



print(yate.para("The entire set of 

"(duplicates removed).")) 

print(yate.include footer({"Home" : "/index.html", "Select another athlete 


'generate list.py"}) 


you are here ► 
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cgis for android 

r 、 Sharpen your pencil 

Solution 



TWis is *tV^c ,, 

C^l. 

#! /usr/local/bin/python3 


import j son 

import athletemodel 
import yate 

names = athletemodel 


Part 2: You weren’t done with that pencil just yet! In addition to 
amending the code to the CGIs that support your web browser’s 
Ul, you also needed to change the CGIs that provide your webapp 
data to your Android app. You were to amend these CGIs, too. 


-from S*bo\rcO 


print(yate.start—response('application/j son ’）） 
print(j son.dumps(sorted(names))) 


/W V^cv-c is , 

Vwa 七 

C6(l 

#! /usr/local/bin/python3 





import cgi 
import j son 
import sys 

import athletemodel 
import yate 


to 七广 b^ausc you^ Ahd^oid app 



form—data = cgi.FieldStorage() 

athlete—name = form_data['which_athlete / ].value 

二 a*thlc*tcmodel cic*t a*thle*te -from id(a*We*te id) 

print(yate.start—response('application/j son ’）） 
print(j son.dumps(athletes[athlete name] .as diet)) 


Add *tWis todc *to 
{\\t tv-cation <yc v-adio 


A 七以 Ids you syct\U 

\/ ah -to 90 with -the ^rad\o but-toh. 


bu-b^s 侁 at provide 
a value -fov- *tV^c 
button 七 ha 七 diWcvs 
{vow 七 V^c bu 七 
七 e% 七 . 


def radio—button 一 id (rb_name, rb_value 

return('<input type="radio" name=" ' + rb name 

1 " value: n ' +\str (rb id)/ : h、 : ~ !, > ' + rb value + ' <br /> 
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Tesr DriVq 


S-ta^rt 
v-cs-tav-*t) Y ov 


Before you run your amended webapp, be sure to move you SQLite database into the top-level 
directory of your webapp (that is, into the same folder your index . html file). That way, your 
model code can find it, so move it into your we bap p's root folder now. When you are ready, take your 
SQL-powered webapp for a spin. 


y/cId scv-vc\r. 

1 _ ^ 

| File Edit Window Help StartYourWebEngine 


$ python3 simple httpd.py 



Starting simple httpd on port : 8080 



« o o 


Welcome to the National Underage Athetics Committee’s Website 




+ 


(k http://local host: 8080 /index.html 


C (O/ Google 


DQ :::: Apple Yahoo! Google Maps YouTube Wikipedia Popular^ 




That worked well. But what about your Android app? 


you are here ► 
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amend for android 


You need to amend your Android app, too 

Unlike your HTML-based webapp, where all of your code resides and is 
executed on your web server, your Android app runs on your phone and it is 
programmed to work with a list of names, not a list of names and athlete IDs. 

When you run coach app . py on your emulator, weirdness ensues … 



Wcv-C s youv duvrcht A^dv-oid 
° h "the cmula*tov. 


app v*uhhihg 


TWis U \s/c'i\rd.. *ms-bcad 
七 he y^awcs, y 。 冰 IS 

disf l3Y m 5 ^ 1’ 也 . 








5554:droid2.2 


® 圆 通 12:30 


Here is your list of athletes: 


["James Lee'M] 


["Julie Jones",4] 


[ n Mikey McManus" f 6] 


["Sally Sanchez",5] (£) 

["Sarah Sweeney' ， ,2] (£) 


Select 


Quit 


1 

2 

一 < . 

3| 

4 

5 1 

6 

7 

8 

9 

o| 

Q 

W 

E 

R 

T 

YU 

U 

I 


P 

A 

s 

D 

F 

G 

H 

J 

K 1 

L 1 

DEL 

<KI 


z 

X 

C 

V 

B 

N 

M 




SYM 

@ 

■ i 

fTMf^ 


Ahd you -bp n，, ， app 

崎 s with a vBulc. 


Just like with the CGI scripts, you need to amend you Android app to work 
with the data that’s now arriving from your web server — that is, a list of lists 
as opposed to a list. 


That shouldn’t take too long, should it? 
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m 




Here is your current coachapp. py code, which you need to amend to support the way your 
webapp's model now works. Grab a pencil and make the necessary changes to this code. 


import android, j son, time 


from urllib import urlencode 
from urllib2 import urlopen 


hello—msg 


="Welcome to NUAC's Timing App" 


list—title = 
quit msg = 
web 一 server = 
get—names 一 cgi = 
get 一 data_cgi = 


'Here is your list of athletes : 
"Quitting NUAC's App." 

'http: "192.168.1.34:8080' 

'cgi-bin/generate_names.py' 

'/cgi-bin/generate_data.py' 


def send_to_server(url, post_data=None) : 

# There is no change to this code from the previous chapter. 


app = android.Android() 


def status 一 update(msg, how_long=2) : 

# There is no change to this code from the previous chapter. 


status—update(hello 一 msg) 

athlete 一 names = sorted(json.loads(send_to 一 server(web—server + get—names_cgi))) 

app.dialogCreateAlert(list—title) 

app.dialogSetSingleChoiceltems(athlete—names) 

app.dialogSetPositiveButtonText('Select') 

app.dialogSetNegativeButtonText('Quit') 

app.dialogShow() 

resp = app.dialogGetResponse().result 

if resp['which'] in ('positive 1 ): 

selected_athlete = app.dialogGetSelectedltems().result[0] 
which—athlete = athlete—names[selected—athlete] 

athlete = json.loads(send—to_server(web 一 server + get 一 data_cgi,{'which—athlete 1 : which—athlete})) 

athlete 一 title = athlete['Name'] + ' (' + athlete['DOB'] + '), top 3 times:' 

app.dialogCreateAlert(athlete 一 title) 

app.dialogSetltems(athlete['Top3']) 

app.dialogSetPositiveButtonText('OK') 

app.dialogShow() 

resp = app.dialogGetResponse().result 
status 一 update(quit—msg) 


you are here ► 
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support the new model 



Here is your current coachapp .py code, which you need to amend to support the way your 
webapp’s model now works. You were to grab a pencil and make the necessary changes to this 
code. 


import android, j son, time 
from urllib import urlencode 
from urllib2 import urlopen 


hello—msg 


="Welcome to NUAC's Timing App" 


list—title = 
quit msg = 
web—server = 
get—names 一 cgi = 
get 一 data_cgi = 


'Here is your list of athletes : 
"Quitting NUAC's App." 

'http://192.168.1.34:8080' 

'cgi-bin/generate_names.py' 

'/cgi-bin/generate_data.py' 


def send—to 一 server(url, post_data=None) : 

# There is no change to this code from the previous chapter. 


app = android.Android() 

def status—update(msg, how_long=2) : 

# There is no change to this code from the previous chapter 


ih c 

OHLY -the 

list o-p lis-ts. 




athletes 



status 一 update g) 

sorted (j son . loads (send_to—server (web—server 

app . dialogCreateAlert (list ti€^e) '-**s a*thlc*tc 二 Ca*thC03 -for a*th *m a*thlc*tcs] 

— 

app.dialogSetSingleChoiceltems(athlete names) 


app.dialogSetPositiveButtonText('Select') 
app.dialogSetNegativeButtonText('Quit') 
app.dialogShow() 

resp = app.dialogGetResponse().result 


This 




is d too\ use ^ 

dompvchchsioh. 


PeWmme IP assofia-bcd 

sclct-tcd a*Wc 七 e. 


if resp['which'] in ('positive'): 

selected—athlete = app.dialogGetSelectedlterns().result[0] 
which_athlete = a*thlrtes[sele^ted_a*We*te][l ] 

athlete = json.loads(send—to_server(web_server + get—data 一 cgi,{ 1 which—athlete': which—athlete})) 
athlete—title = athlete['Name'] + ' (' + athlete['DOB'] + '), top 3 times:' 

app. dialogCreateAlert (athlet^j^itle^ 

app. dialogSetltems () a*thle*ter*top 孓 ’] 

app.dialogSetPositiveButtonText('OK') 
app.dialogShow() 

resp = app.dialogGetResponse().result 
status update(quit msg) 



adjus-tm Ch -t 

aucss 
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puzz] 


e 


Your job is to take the code from the pool and place it into 
the blank lines in the program. Your goal is to write 
the code to have your app provide the user with a 
mechanism to add a timing value to the server for 
the currently selected athlete. For now, send your 
data to the cgi-bin/add_timing_data . py 
CGI script. 

Hint: the code from get2inputsapp.py (from earlier in 
this chapter) should come in handy here. 


/\aa a^o-b^cv- ^ 

app. dialogSetNegativeButtonText ( 'Add Time ') 义一 乂 ^ . 七 tuVVwt vcd 。 灼 oA* 


if resp['which'] in ('positive') 
pass 



5纖 ’ 


a 



send to server(web server + add time cgi , {'Time' : new time, 'Athlete' : which athlete}) 



some input is 
supplied, schd it 
"to "the web sevvev" 
with -the 

athlete’s O 
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allow android input 


pu^zjc 

Your job was to take the code from the pool and place it 
into the blank lines in the program. Your goal was 
to write the code to have your app provide the user 
with a mechanism to add a timing value to the server 
for the currently selected athlete. For now, you 
were to send your data to the cgi-bin/add— 
timing—data • py CGI script. 

Hint: the code from get2inputsapp.py (from earlier in 
this chapter) should come in handy here. 

app.dialogSetNegativeButtonText('Add Time') 



if resp['which'] in ('positive') : 
pass 

elif resp['which'] in ('negative'): 

timing—title = 'Enter a new time' 

timing msg = 'Provide a new timing value ' + athlete['Name 

add_time_cgi ='/cgi-bin/add_timing_data.py' 


-the dialog’ 
"titles 3hd spedi-py 
■the C6i\ -to schd 
the daia -to. 


resp = app•dialogGetlnput(timing_title, 


if resp is not None : 


timing_msg).result 

. 


dv\d W 七 


new_time — resp 


send_to_server(web_server + add_time 一 cgi,{'Time': new 一 time, 'Athlete' : which athlete}) 
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Tqst DriVQ 


Use the tools/adb command to copy your latest app to the emulator, and give your app a go. 




SSS4 dr(Md2.2 






■RflCS 2:52 








Ql 


SSS4 droid2.2 


Vera Vi (2002-12-25), top 3 
times: 



SSS4 druid2.2 


■■Cl 2:52ra 


Select ’ 

fvow *bV\c list 

o*(* … 


尸 



Add Time 


… "to see l/cva^s -top 3 
"thch "tap 七 [^ 
Ydd TiW UW.. 



^ Enter a new time 

Provide a new timing value 
Vera Vi: 


•33| 


Ok 


Cdricel 


1 

2 j 

3| 

4 

5 

6 

7 j 

8 

9 fi 

0 

q|| 

W 

E 

R 

T il 

Y 

U 

I 

0 

P 

A 

S 

D 

F 

G 

H 

J 

k| 

L 

DIL 

❖ 

z 

X 

C 

V 

B 

N 

M 

• 



$YM 

@ 

I I 

/ 

$ 



Great: your data 
is sent from your 
Android app to 
your web server. 


^1 

..-bo cv\*tcv- a y\c^i 

七 iwc, v/WitV^ \s 
scv>*b *to 

youv >/c1d SCWCV". 


V 


I File Edit Window Haln Data From Android 


$ python3 simple—httpd.py ] 

Starting simple—httpd on port: 8080 I 

198.162.1.34 - - [27/Sep/2010 14:51:47] "GET /cgi-bin/generate_names.py H^?P/1.1" 200 - 

198.162.1.34 - - [27/Sep/2010 14:52:01] "POST /cgi-bin/generate_data .b^^TTP/1.1" 200 - 

198.162.1.34 - - [27/Sep/2010 14:52:19] "POST /cgi-bin/add_timing_d^^?rpy HTTP/1.1” 200 - 

localhost, 198.162.1.34, Mon Sep 27 14:52:19 2010 : POST : Athlete->3 Time->1.33 


you are here ► 
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database update 


Update your SQLite-based athlete data 

All that’s left is to change the cgi-bin/add_timing_data . py CGI 
script to write your submitted data to your database, as opposed to the web 
server’s console screen. 

At this point, it’s a trivial exercise, because a single SQL INSERT statement 
will do the heavy lifting. 


©o ^ 


add_timing_data.pv - /Users/banrvp/HeadFirstlPythoFii/chapter9/cgj-birt/add_timing_data.py 


#1 /usr/local/bin/python3 

import cgi 
import sglite3 

import yate 

print (yate.start 一 response! 'text/plain 1 ) 

form = cgi.Fieldstorage(} 
the_id - £orm_data[ 'Athlete' ].value 
the - time = form data[ 'Time' ].value 


-the da-b sch-t io you\r web 

卜 w -fvom you^* Ahdvoid 


app. 


connection = sglite3.connect( ' coachdata.sqlite 1 ) 
cursor = connection,cursor() 

cursor■execute( "INSERT INTO timing data (athlete id 

(theid, the 一 timej) 

connection.c ommit() 
connection.close)) 


value) VALUES (?, 7) 1 ' f 


/h 


print ( f OK 


INSERT data youv 

table. 


Ln: 22 


Cof: 0 




With this version of your CGI script running on your web server, any new 
times entered by anyone on an Android phone are added to the data in the 
database. 

The NUAC no longer has to worry about adding data to text files, because 
the files are effectively obsoleted by the use of SQLite. 

You’ve produced a robust solution that is more manageable, scalable, 
programmable, and extendable. And it’s all thanks to the power of Python, 
it’s database API and the inclusion of sqlite3 in the standard library. 

All that’s left to do is sit back, relax and bask in the 
glory of your latest programming creation... 
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The NUAC is over the moon! 


Of course, your use of SQLite gives you more than just easy insertions 
of data. With the NUAC’s data in tables, it’s easy to answer some of the 
questions that have been on their mind. 



To answer these and other queries on the data in the NUAC’s database, you’ll 
have to bone up on your SQL. Then it’s up to you to take it from there. 


You’ve converted your webapp to use an SQL database. As your data 
management needs increase, you can consider alternative heavy-duty data 
management technologies as needed. 


This is great work. Your webapp is ready for the big time. 


you are here ► 
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python toolbox 


0 


Your Pythow Toolbox 

You’ve got Chapter 9 under your 
belt and you’ve added some 
key Python tools to your evey 
expanding Python toolbox. 




yoyra 州 . 


ohc oy 


Database Lihjo 

參 u Da*tabasc ;; - a toWttho^ 
啪。代 tables. 


魯 UTablc；； - a ^ollcdtioh of OhC OV^ move 

^ows daU a^cd as 
^olumhS* 

@ U S^L ;, - £hc u SWtuvcd ^uc\ry 

Lah 9 ua 3 c；； is Uhguajc o( ihc 
database wo^rld ahd \i lets y ou wo^-k 

w.th you^r data i, y ou ^ database U si h a 
statcmchts sudh as CREATE, IH^BRT 

ahd SELECT. ； 




■ 


■ 


■ 


■ 


■ 


■ 


■ 


■ 


■ 


BULLET POINTS 


The f ieldStorage () method from 
the standard library’s cgi module lets 
you access data sent to your web server 
from within your CGI script. 

The standard os library includes 
the environ dictionary providing 
convenient access to your program's 
environment settings. 

The SQLite database system is included 
within Python as the sqlite3 standard 
library. 

The connect () method establishes a 
connection to your database file. 

The cursor () method lets you 
communicate with your database via an 
existing connection. 

The execute () method lets you send 
an SQL query to your database via an 
existing cursor. 

The commit () method makes changes 
to your database permanent. 

The rollback () method cancels 
any pending changes to your data. 

The close () method closes an 
existing connection to your database. 

The “？” placeholder lets you parameterize 
SQL statements within your Python code. 


ONSPH.S 
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10 scaling your Webapp 


參 


Getting real ♦ 



The Web is a great place to host your app.. .until things get real. 

Sooner or later, you’ll hit the jackpot and your webapp will be wildly successful. When that 
happens, your webapp goes from a handful of hits a day to thousands, possibly ten of 
thousands, or even more. Will you be ready? Will your web server handle the load? How 
will you know? What will it cost? Who will pay? Can your data model scale to millions 
upon millions of data items without slowing to a crawl? Getting a webapp up and running 
is easy with Python and now, thanks to Google App Engine, scaling a Python webapp is 
achievable, too. So...flip the page and find out how. 


this is a new chapter 
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a whale of data 


There arc whale sightings everywhere 

The Head First Whale Watching Group (HFWWG) coordinates the live 
cetacean sightings for the entire country. To date, they’ve provided a PDF 
form on their website that members of the public can download, fill in, and 
mail to the HFWWG central office. 

The form contains the essential data needed to record the sighting: 




HFWWS.ORG 



Fin Type ： 


Blow Type: Tall 


Wave Type: 


Falcate 

Triangular 

Rounded 

Humpback 

Orca 

Blue 

Beluga 

Fan 

Gray 

Tall 

Bushy 

Dense 

Flat 

Small 

Moderate 

Large 

Breaking 

High 


Killer 

Sperm 


After a busy sightings weekend, the central office is swamped with completed 
forms for thousands of sightings.. .which is a data-entry nightmare as all those 
forms can take an age to process manually. There’s nothing worse than being 
stuck in front of your computer entering data when all you want to do is be 
out on the water looking for humpbacks ... 
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scaling your webapp 


The HFWWft needs to automate 




Ideally, a solution that works on 
the Web would be great. That 
way, anyone from anywhere 
could record a sighting. Look! 
Theres one... 


Q 



Suggesting to the HFWWG that they invest in an expensive web hosting 
solution isn’t going to make you any friends. It’s way too expensive to buy 
the capacity they’ll need for the busy weekends and a total waste of capacity 
when sightings are infrequent. 

Suggesting that they invest in a large, state-of-the-art web server that can be 
hosted in the central office is also a nonstarter: there’s no one to look after a 
setup like that, and the broadband link required to handle the anticipated 
traffic would blow the their budget right out of the water. 


Is there another option? 
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enter app engine 


Puild your webapp with Google App Engine 


Google App Engine (GAE) is a set of technologies that lets you host your 
webapp on Google’s cloud computing infrastructure. 

GAE constantly monitors your running webapp and, based on your webapp 5 s 
current activity, adjusts the resources needed to serve up your webapp’s pages. 
When things are busy, GAE increases the resources available to your webapp, 
and when things are quiet, GAE reduces the resources until such time as 
extra activity warrants increasing them again. 

On top of this, GAE provides access to Google’s BigTable technology: a set of 
database technologies that make storing your webapp 5 s data a breeze. Google 
also backs up your webapp’s data on a regular basis, replicates your webapp 
over multiple, geographically dispersed web servers, and keeps App Engine 
running smoothly 24/7. 

And the best part? GAE can be programmed with Python. 

And the even better part? You can start running your webapp on GAE for free. 



Five million page views? That’s a lot of sightings... 


charge and will continue to do so until your webapp 
processes five million page views per month. Once it 
exceeds this threshold, you’ll need to pay Google for 
the extra capacity used. If you never reach the limit, 
your use of GAE is not charged. 


Initially, there isn’t one. 

Google provides this webapp hosting service at no 
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download and mstall App Engine 


When your webapp is ready for deployment, you’ll upload it to the Google 
cloud and run it from there. However, during development, you can run a test 
version of your webapp locally on your computer. All you need is a copy of 
the GAE SDK, which is available from here: 



http:/ / code, google, com/appengine/ 




Download the GAE Python SKD for your operating system. Windows, Mac 
OS X, and Linux are all supported, and installation is straightforward. 




0v\ a 


►y/ -(•oldcv' tsllcd 

\s crtaitd a-fW a 


给 AE uses Python 15 


The version of Python built into GAE is a modified version of the Python 2.5 
release. As when you worked with Python for Android, the fact that you aren’t 
running Python 3 isn’t such a big deal with GAE, although you do need to 
ensure Python 2.5 is installed on your computer. Open up a terminal window 
and type: 

python2.5 -V 

If this command gives an error, pop on over to the Python website and grab 
the 2.5 release for your operating system. 



Aren’t things going backward here? First, there was Python 3, then it was Python 2.6 for Android, and now we are dropping 
down to 2.5 for App Engine? What gives? 

That’s a great question. It’s important to remember to always code to the restrictions placed on you.You might think that it sucks that GAE 
runs on Python 2.5, but you shouldn't. Think of it as just another restriction placed on the code you write—that is, it must target Release 2.5 
of Python. As with the Android code you created in the previous chapters, the GAE code you are about to write is not all that different than the 
Python code for 3. In fact, you will be hard pressed to spot the difference. 


you are here ► 


355 




testing app engine 


Make sure App Engine is working 

The environment supported by GAE within the Google cloud supports 
standard CGI or Python’s WSGI. To build a GAE-compatible web app, you 
need three things: a folder to hold your webapp’s files, some code to execute, 

and a configuration file. 

To test your setup, create a folder called mygaetest. Within the folder, 
create a small CGI you can use to test GAE. Call this CGI sayhello . py. 
Use this code: 


print('Content-type : text/plain\n' 


print('Hello from Head First Python on 


The configuration file must be called app . yaml and it, too, must be in 
your webapp’s folder. This file tells the Google cloud a little bit about your 
webapp’s runtime environment. Here’s a basic configuration file: 


youv a^d i\\t same 

-tells 6if(B. 七 ha 七 youv* webapp 
is w\ri 七七⑶ .m v/ill \rur> ov\ Py 七 ho 灼 . 


TUk of the bhdlW 冰七 IOh W ^ - url(77*^) 

thc^oh+.guiratioh ^ilc as a iop-lcvcl L script: sayhello. py 
w—p lrou-tih 9 


application : mygaetest 
version : 1 
runtime : python 
api_version : 1 冬 

handlers : 


r 


this! 


saY^cllo?V' 


Go ahead and create the folder called 
mygaetest and the two files shown here. 



app.y^l 


It doesh'i get 州 u 匕 h 

easieir thcih this … a 
plaih-tcxt message is 
displayed within youv 
bvowsev- whcncvcv 
"this C^l vuhs. 



Uc 败 sioh” li hC idMcs ihe 

匕 m*Cht vcirsioh o( y ou ^ webdPP 
(ahd usually siaris at IX 


md^a-tes 代 lease ol 

you avc 七 … 3. 




This eirbry 七 ells "to vouic 

all v-c^ucs-ts {jo you\r webapp -to 
youv u sayhcllo.py w pvojvam. 
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Tesr DriVq 


Cli 乙 k this 

but-fcoh -to 
youv- 
webapp. 


The GAE SDK includes a test web server, so let's use it to take your test GAE webapp for a spin. If you 
are running on Windows or Mac OS X, fire up the Google App Engine Launcher front end. This tool 
makes it easy to start, stop, and monitor your webapp. On Linux, you’ll need to invoke a command 
to kick things off. If you are using the GAE Launcher, choose File -> Add Existing Application from 
the menu system to browse and select your we bap p's folder. Also: be sure to edit the Launcher’s 
Preferences to select Python 2.5 as your preferred Python Path. 



GoogleAppEngineLauncher 


Run Stop Browse Logs SDK Console 




Edit 


Name 


aetest 


Path 


/Users/barryp/HeadFirst 



Deploy Dashboard 


aetest 


Port 


8080 


is h 。 

Chd -rov Lihux, so 

yowr 与 webapp -the 

乙 ommdhd lihe. 


I File Edit Window Help GAEonLinux 


python2.5 google appengine/dev appserver.py mygaetest/ 






INFO 2010-10-02 12:41:16,547 appengine_rpc.py:149] Server : appengine.google.com 
INFO 2010-10-02 12:41:16,555 appefg.py:393] Checking for updates to the SDK. 

INFO 2010-10-02 12:41:17,006 appcfg.py:407] The SDK is up to date. 

WARNING 2010-10-02 12:41:17,007 datastore_file_stub.py:657] Could not read datastore data 
from /tmp/dev_appserver.datastore 

INFO 2010-10-02 12:41:17,104 dev_appserver_main.py:431] Running application mygaetest 
on port 8080 : http://localhost:8080 


TV\\s is \\o^ 七 he 

LauWc 矿 

looks or\ Mat 0^ 

X..* 七 looks siw'ilav 

oy \ lVmdo>ws. 

With your webapp running and waiting on port 8080, open your favorite web browser and surf on 
over to the http : // localhost : 8080/ web address. 


科 r> n 


http://localhost: 8060/ 




+ 

0 http://localhost ： e0S0/ <5 j 




Google 


PP :::: Apple Yahoo! Google Maps VouTube Wikipedia Popufar 


Kello from Kead First Python on GAE 

/ \y\d __ 

七 message -f'row 

youv- >wcba^! 


A 
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more work? 




Yes, it is more work. But that’s about to change. 

For now, this is more work than you’re used to, but remember that 
this is just a quick test to make sure your GAE test environment is 
up and running (and it is). When you start to work with some of 
GAE’s web development features, you’ll initially see that there’s a 
lot more going on behind the scenes than meets the eye. 


358 Chapter 10 


scaling your webapp 


App Engine uses the MVC pattern 


Google has built GAE to conform to the familiar Model-View-Controller 
(MVC) pattern. 

Like your webapp from the previous chapter, the model component of a 
GAE-enabled webapp uses a back-end data storage facility that’s known as 
the datastore. This is based on Google’s BigTable technology, which provides 
a “NoSQL” API to your data, as well as a SQL-like API using Google’s 
Query Language (GQL). 

GAE’s views use templates, but unlike the simple string templates from the 
previous chapter, GAE uses the templating system from the Django 
Project, which is one of Python’s leading web framework technologies. In 
addition to templates, GAE includes Django’s for ms-building technology. 

And, of course, any controller code is written in Python and can use the 
CGI or WSGI standards. Unfortunately, you can’t use your yate module 
with GAE, because it is a Python 3 library (and would need to be extensively 
rewritten to support Python 2). Not to worry: the facilities provided by GAE 
'out of the box’’ are more than enough to build great web app s. 


TV^c Model 


The |/ie w 



TV^ Co^voWcv* 



So...like any other webapp that I build, 
with App Engine I define a model for my data, 
create some templates for my view, and then 
control it all with code, right? 


Yes, it’s the same process as any other webapp. 

Google has worked hard to ensure that the move to App Engine 
is as painless as possible. If you understand MVC (as you now 
do), you are well on your way to creating with GAE. It’s just a 
matter of working out how GAE implements each of the MVC 
components. 
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model data 


Model your data with App Engine 

App Engine refers to data items stored within its datastore as properties ， which 
are defined within your model code. 


Think of properties as a way to define the name and types of data within 
your database schema: each property is like the column type associated piece 
of data stored in a row，which App Engine refers to as an entity. 




As with traditional SQL-based databases, your GAE datastore properties are 
of a specific, predeclared type. There are lots to choose from, for instance: 

db.StringProperty: a string of up to 500 characters 

db.Blob: a byte string (binary data) 

db.DateProperty: a date 
db.TimeProperty: a time, 
db.IntegerProperty: a 64-bit integer 
db.UserProperty: a Google account 

sa —c data W 


for ^ull 

iyycs su 代 ov 七 cd, 挪 0 了 

•to 

aw 十 七“’十如 " c/ 

切 ? 心却呼 却 I 拉 dl aM 
-take a look. 


Hcvcs some 
如 V 代 — s ⑽七 cr . 


S-fcov-c 七 his data as 
u dbS-t\r*mjPv-opcv-ty^. 


TWis data is sWd as,, 
a w afe l^^o^v . 


id 

r；\ 


3 

4 


w 


James Lee 
Sarah Sweeney 
Vera Vi 
Julie Jones 
Sally Sanchez 
Mikey McManus^ 


2002-03-14 

2002-06-17 

2002-12-25 

2002-08-17 

2002-11-24 

2002-02-24 


"Hjis dsis is sicced ss 

a db.DatePvopevty”. 
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|w^o\rt KK d\> 
module *fv-ow *tV)C 

c%*bcir\s'ioy\s. 




aa] Puzzjc 


Your job is to take the properties from the 
pool and place them in the correct 
place in the class code, which is in a 
file called hfwwgDB . py. Your goal 
is to assign the correct property type 
to each of the attributes within your 
Sighting class. 



from google.appengine.ext import db 


class Sighting(db.Model) 

〔 name = . 

email —— 






,s ^ssijhcd "to d 




date 


time 


location = 
fin_type — 
whale_type 
blow—type : 
wave type : 
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property types 



Paa] puzzjc 

Your job was to take the properties from 
the pool and place them in the correct 
place in the class code, which is in a 
file called hfwwgDB . py. Your goal 
was to assign the correct property 
type to each of the attributes within 
your Sighting class. 


from google.appengine.ext import db 



class Sighting(db.Model) : 


name — 
email —— 
date — 
time —. 
location = 
fin_type = 
whale_type 
blow—type : 
wave type : 


db.StringProperty() 
db.StringProperty() 
db.DateProperty() 
db.TimeProperty() 
db.StringProperty() 
db.StringProperty() 
db.StringProperty() 
db.StringProperty() 
db.StringProperty() 



Evciry-thihg is a 
U S-t\rihgPvopcv-ty w ; 
except -the “date" ahd 
七⑽ 〆 -fields. 
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What good is a model without a view? 

GAE not only lets you define the schema for your data, but it also creates 
the entities in the datastore. The first time you go to put your data in the 
datastore, GAE springs to life and makes room for your data. There’s no 
extra work required by you, other than defining your model in code. It’s 
useful to think of GAE as executing something similar to a SQL CREATE 
command on the fly and as needed. But how do you get data into the GAE 
datastore? 



The short answer is thatjoz/ put it there, but you first need to get some data 
from your webapp 5 s user...and to do that, you need a view. And views are 
easy when you use templates. 

App Engine templates m an instant 

Recall that the templating technology built into GAE is based on technology 
from the Django Project. Django’s templating system is more sophisticated 
than the simple string-based templates used in the previous chapter. Like your 
templates, Django’s templates can substitute data into HTML, but they can 
also execute conditional and looping code. 

Here are four templates you’ll need for your HTWWG webapp. Two of them 
should be familiar to you: they are adaptions of those used in the previous 
chapter. The other two are new. Go ahead and grab them from this book’s 
support website. As you can see, rather that using the $name syntax for 
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use a template 


Use templates m App Engine 

To use a template, import the template module from google . 
appengine . ext. webapp and call the template . render () function. 
It is useful to assign the output from template . render () to a variable, 
which is called html in this code snippet: 


from google. appengine. ext. webapp import template s-tcUrt with y ou y- import 


html = template.render('templates/header.html', {'title': 'Report a Possible Sig ： 


Call 

代 hdeirO” … 





...supplymg ihc 

This is similar to the mechanism your yate . py module uses to parameterize 
the data displayed within your HTML pages. 


… as y/cII 私 a dkWaw 栋 a 七 w 尸 values {p 
七 k named 七 c—a 七 c vahaWc. 



Yes, create your view with templates. 

Just like the other web app s that you’ve built, you 
can create your view in much the same way using 
Python code. It’s a bummer that you can’t use your 
yate . py module, but Django’s templates provide 
most of the functionality you need here. 


D 


tWeiar 

)umb 


e no o 

Questions 


Should I create one big template for my entire web page? 


You could, if you want. However, if you build up your view from snippets of HTML in templates, you open up the possibility of reusing those 
HTML snippets in lots of places. For instance, to maintain a consistent look and feel, you can use the same header and footer template on all of 
your web pages, assuming of course that your header and footer aren’t already embedded in an entire web page (which can’t be reused). 
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qr your pencil 



Let’s write the rest of the code needed to create a view that 
displays a data entry form for your HFWWG webapp. 

In addition to your web page header code (which already exists 
and is provided for you), you need to write code that starts a new 
form, displays the form fields, terminates the form with a submit 
button, and then finishes off the web page. Make use of the 
templates you’ve been given and (here’s the rub) do it all in no 
more than four additional lines of code. 


TWis todt ^ocs *m*to a 


lied 






from google.appengine.ext.webapp import template 


html = template.render('templates/header.html', {'title 1 : 'Report a Possible Sighting 1 }) 



Rcwcwfecv -： v\o 
wove 





❺ 


Now that you have attempted to write the code required in no more than four lines of code, what 
problem(s) have you encountered. In the space below, note down any issue(s) you are having. 
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data-entry display 

厂 Sharpen your pencil 



You were to write the rest of the code needed to create a view 
that displays a data entry form for your HFWWG webapp. 

In addition to your webpage header code (which already exists 
and is provided for you), you were to write code with starts a 
new form, displays the form fields, terminates the form which a 
submit button, then finishes off the webpage. You were to make 
use of the templates you’ve been given and (here’s the rub) you 
had to do it all in no more than four more lines of code. 


from google.appengine.ext.webapp import template 


html = template.render('templates/header.html', {'title': 'Report a Possible Sighting'}) 

The always / ,r 

. ; 

*tc^pla*tc.rehdcr( ； *tcimpla*tcs/form—star 七 .h 七 ml’, {}) 


html = html + 


TWis is issue, 

’七 I 七？ 


\Nt heed to generate *the FORM -fields *m here...but how?|? 



Ivtml 二 IvW + *te 叶叶 la*tes/*fo\rm_er\d.lvb^l’ ， rsub_ti*tle ’ ： l Submi*t Si^lvti^}) 
Ivtml 二 Ivtml + a*tes/<foo*ter.lvW' {Yrnks ’： ’’}) 


❺ 


Having attempted to write the code required in no more than four lines of code, you were to make a 
note of any issue(s) you encountered. 


This, is J/yip! 9 S£|BL)£. ip do ih jus*t -fouy* lihcs Codc K .bcdjSlusc . s . .^P vyay 


: t?. .ib?. FOR/V). fields, ihcii.l. .^ccd... . 1 ： i . cych use . iKc . “ 如」 ! pirW’ . 

>yiiK•PyihpnH". 
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Wouldn t it be dreamy if I could avoid 
hand-coding a <FORM> and generate the 
HTML markup I need from an existing data 
model? But I know it's just a fantasy... 
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more borrowing from django 


PJa 叫 o's form validation framework 

Templates aren’t the only things that App Engine “borrows” from Django. 

It also uses its form-generating technology known as the Form Validation 
Framework. Given a data model, GAE can use the framework to generate the 
HTML needed to display the form’s fields within a HTML table. Here’s an 
example GAE model that records a person’s essential birth details: 


TWis code is m a -f ile 
tailed W W 七 ⑽ .?/. 



— 

from google.appengine.ext import db 

class BirthDetails(db.Model) : 

name = db.StringProperty() 

date_of_birth = db.DateProperty() 
time_of_birth = db.TimeProperty() 


This model is used with Django’s framework to generate the HTML markup 
needed to render the data-entry form. All you need to do is inherit from a 
GAE-included class called django forms .Model Form: 


I 个 rt 如 l-.WavY m addrb •咖 

-bo you\t data wodcl. 


class BirthDe tailsForm (djangof orms • Model Form) — … t ; 。州 "the 


from google.appengine.ext.webapp import template 
from google.appengine.ext.db import djangoforms 
import birthDB 



class Meta : 

model = birthDB.BirthDetails 




hew 





html = template.render('templates/header.html ', {'title': 'Provide your birth details '}〉 
html = html + template.render('templates/form start.html ', {}) 


html = html + (str (BirthDetailsForm (auto—idsFalsejlJ^^- 


Use 
youv- 


Y\C^I 


tlass -to yyvcv-a-bc 


html = html + template.render('templates/form_end.html 、 {'sub 一 title': 'Submit Details'}) 

html = html + template.render('templates/footer.html ', {'links': ''}) 




368 Chapter 10 











scaling your webapp 


Check your form 


The framework generates the HTML you need and produces the following 
output within your browser. 



I 七 ’s wo 七七 k 
CVCV" vnddC) bu 七 •’ 七 

Y/OV"ks. 


h 卜 ' f 、 Provide your birth details 

， ► | + 1 ^ h!tp://localhost：e0Sl/ C 〔0^ Google 

PQ 5555 Apple Yahoo! Googfle Maps YouTube Wikipedia PopufarT 


Provide your birth details 


Name: 


Date of birth: 
Time of birth: 


iSubmit Details , 



A 


Use the View Source menu option within your web browser to inspect the 
HTML markup generated. 




Source of: http://[ocalhostL80Si/ 


<htini> 

<hcad> 

<titlo>Provide your birth details</titlo> 

</head> 

<body> 

<hl>Provide your birth details</hl> 

<form method— "POST" action * 11 /'> 

<tahlo> 

<tr><t,h>Wanie t input type=^ rJ text M name« 11 name 11 /></td></tr> 

<tr><th>Date of birth : <yth><td><iaput type^' 1 text 11 name 1 1 date_of_bIrth 1 ' 

■Time of birth : <7tt><td><iaput type=« "text 11 name^ _blrth" /></td></tr><t,r> 
>/iSbs p j < / 1 h> <td>< input, type*" submit" value ■"Submit Details " 

</tafele> 

</£ornt> 

<px/p> 

</body> 


fl SCii ^ >^ W ^ W i, yo,, Code , he 



仏 c y\dmes used m youv wodcl). 


■t’s time to tie things all together with your controller code. 
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controller code 


Controlling your App Engine webapp 


Like your other webapps, it makes sense to arrange your webapp controller 
code within a specific folder structure. Here’s one suggestion: 


- 





Put dll o( youv wcbdpp^s 
^Ohtirollcir Code ahd 
^oh-figuira-tioh -files ih hcvc. 



you hvc 

七 ^ 一 卜七 •、 七 h V^c^rc (at momc 此 

•bWis ^oldcv is 叫切 ). 


fVt youv- HTA/IL 
^ 一 " "" "tcmpla-tcs ih hcv-c. 


， ou’ve seen, any CGI can run on GAE, but to get the most out of Google’s 
technology, you need to code to the WSGI standard. Here’s some boilerplate 
code that every WSGI-compatible GAE webapp starts with: 

|rw^0V"t Af? ^• from google. appengine. ext import webapp 
py\^'mC s 

class. 


Create dh 
object - 

tov- youv 
appliGtioh. 



a utili-ty iha-t 
v-i»hs youv webdpp. 


from google.appengine.ext.webapp.util import run_wsgi_app 
class (^ndexPage^webapp.ReguestHandler) : 

TW,s W ▲“昧丁 “ -一 
一 1S stewed fey youv v/efea^. 


app = webapp.WSGIApplication([('/•*',\IndexPage)p, debug=True) 


^\lTh\s 


T\\\s tlass 
v-cspoy\ds *to 3 
y/cId v-c^ucst 

Y ouV， 叫士 
1 d\toy/scv". 


def main() 


run 一 wsgi 一 app(app^^^ Y ouV， 


if _name 

main() 


main 


^T 


Xst usc these two of Code 


3s—is. 




is 


^oi uhlike 
SVv '*t^hihg ok 
"t^cl^kih 


3. 
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App Engine Code Magnets 



Let’s put everything together. Your model code is already in your hfwwgDB . py 
file. All you need to do is move that file into your we bap p's top-level folder. Copy 
your templates folder in there, too.Your we bap p's controller code, in a file called 
hfwwg. py, also needs to exist in your top-level folder. The only problem is that 
some of the code’s all over the floor. Rearrange the magnets to fix things. 


from google.appengine.ext import webapp 

from google.appengine.ext.webapp.util import run—wsgi app 
from google.appengine.ext import db 
from google.appengine.ext.webapp import template 
from google.appengine.ext.db import djangoforms 


AH o-p "the iw»poV""ts 

have survived".so 

theiress ho heed -fco 
-them. 


Lets icsi V^ov/ v/cll 

you’ve low ?个令 

attention. T^cv-c s 
|nr\cs oy\ 
doov-. 


Wa 七、 wiss ' m ^ 


html = template.render('templates/header.html', {'title': 'Report a Possible Sighting'}) 
html = html + template.render('templates/form start.html', {}) 


html = html + template.render('templates/form_end.html', {'sub—title': 'Submit Sighting'}) 

html = html + template.render('templates/footer.html', {'links': ''}) 


app = webapp.WSGIApplication ([( y /.* r , SightinglnputPage)], debug=True) 


def main() : 

run wsgi app(app) 




Treves ov\t small 

boilc^latc 

mode rn 

Y,oi Ukcd 


if _name— 

main() 


main 



htiul 


html 




class SightinglnputPage(webapp.RequestHandler) 
def get(self )： 


self. 


response, out, write (html) 
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App Engine Code Magnets Solution 


Let’s put everything together. Your model code is already in your hfwwgDB . py 
file. You were to move that file into your webapp’s top-level folder, as well as copy 
your templates folder in there, too.Your we bap p's controller code, in a file called 
hfwwg. py, also needs to exist in your top-level folder. The only problem is that 
some of the code’s all over the floor. You were to rearrange the magnets to fix 
things: 



from google.appengine.ext import webapp 

from google.appengine.ext.webapp.util import run wsgi app 
from google.appengine.ext import db 

from google.appengine.ext.webapp import template . 

from google . appengine . ext. db import dj angoforms 


vodc\ 


import hfwwgDB 


class SightingForm(djangoforms.ModelForm) 


class Meta : 


model = hfwwgDB.Sighting | 



class SightinglnputPage(webapp.RequestHandler) 
def get(self) : 


tJzrV si 舛， 

that ihhcirits Wo^ -the 

dj—o./VIodelFoW dass. 

TV^c tended V^a^alcv tlass \s tailed 

厂 called V ^ 呼 “ a 


html = template.render('templates/header.html', {'title': 'Report a Possible Sighting'}) 
html = html + template.render('templates/form start.html', {}) 


html = html 


+ (SightingForm()) 、 UUc the ““ the HTML 


V-CSpohSC. 


html = html + template.render('templates/form_end.html A , {'sub—title': 'Submit Sighting'}) 
html = html + template.render('templates/footer.html', {'links': ''}) 


self.response.out 


.write (html)~ DM Vou <\ucss i\\\s You *to scy ^ ^ 


v-cs^oy\sc 
oJ? Code docs jus-t 七七 . 


app = webapp.WSGIApplication([('/•*', SightinglnputPage)], debug=True) 

def main() : 

run wsgi app (app) 


if _name— 

main () 


main 
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Tesr DriVq 


It’s been a long time coming, but you are now ready to test the first version of your sightings form. 

If you haven't done so already, create an app . yaml file, too. Set the application line to hfwwg 
and the script line to hfwwg. py. One final step is to use the Add Existing Application menu option 
within the GAE Launcher to select your top-level folder as the location of your webapp. 




GoogleAppEngmeLaimcher 


CD 




咖删1 


Rin ： 5top Browse Logs 5DK Console Edit 





Deploy Dashboard 


Path 


/Users/barryp/HeadFirstPythQn/chapter 10/mygaetest 


/Users/barryp/HeadlFirsiPython/diapterlO/hfww 



Port 


80 SO 


臟 1 


丁 he l^uh^hcv- adds youv 

webapp ih-to its list 

Ad assign \i the hext 
Available pvo-to^ol povt— 

this case, 0OGI. 



_i_■ 

Report a Possible Sighting 


< 

+ http:// local hos t:80Sl/ 

C (<V Google 

□am ， 

Apple Yahoo! Cooglle Maps YouTube 

Wikipedia PopytarT 



Report a Possible Sighting 



A^d here’s youv 

^^aied HTML 

dll its glovy. 


Name: 
Email: 
Date: 
Time: 
Location: 
Fin type: 
Whale type: 
Blow type: 
Wave type: 


— Submit Sigfitingi 




This is looking good. Let’s get a quick opinion from the 
folks over at the HFWWG. 
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make it pretty 


o 


I know what you're thinking ： ''With a shirt like 

how can this guy possibly know anything about 
style?’’... But let me just say that your form could do 
with a bit of, well...color, couldtVt it? Any chance it 
could look nicer? 



OK, we get it. Web design is not your thing. 

Not to worry, you know all about code reuse, right? So, let’s reuse 
someone else’s cascading style sheets (CSS) to help with the “look” 
of your generated HTML form. 

But who can you “borrow” from and not lose sleep feeling guilty over 
it? 

As luck would have it, the authors of Head First HTML with CSS & 
XHTML created a bunch of stylesheets for their web pages and have 
made them available to you. Grab a slightly amended copy of some 
of their great stylesheets from this book’s support website. When you 
unzip the archive, a folder called static appears: pop this entire 
folder into your webapp’s top-level folder. 

There’s a file in static called favicon . ico. Move it into your 
top-level folder. 


Improve the look of your form 

To integrate the stylesheets into your webapp, add two link tags to your 
header . html template within your templates folder. Here’s what the 
tags need to look like: 

<link type="text/css" rel="stylesheet" href =l, /static/hfwwg. css" /> 
<link type="text/css" rel="stylesheet" href= n /static/styledform.css n /> 


Add these -two lihes -fco the 

youv Vadcv.hUr 
I 七加 plaie. 


GAE is smart enough to optimize the delivery of static content —— that is, 
content that does not need to be generated by code. Your CSS files are static 
and are in your static folder. All you need to do is tell GAE about them to 
enable optimization. Do this by adding the following lines to the handers 
section of your app . yaml file: 


Provide the URL lo^tioh 

you\r sbti 匕匕 Ohtcht 



o ? 七 • iw . 丨2-3七 io 灼. 
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Tesr DriVq 


With your stylesheets in place and your app . yaml file amended, ask your browser to reload your form. 


Look 〜 ^ood- 



Report a Possible Sighting 
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list of choices 


Restrict iwput by providing options 

At the moment, your form accepts anything in the Fin, Whale, Blow, and 
Wave input areas. The paper form restricts the data that can be provided for 
each of these values. Your HTML form should, too. 



TWis 

Coy\^tv\hoY\ 

\\t\^ 

七 hese l'is*ts as 

wtam 叫 

values. 


FINS = 
WHALES 
BLOWS : 
WAVES : 


Anything you can do to cut down on 
input errors is a good thing. As the youngest 
member of the group, I was ''volunteered” to 
work on data clean-up duties... 



Providing a list of choices restricts what users can input. 

Instead of using HTML’s INPUT tag for all of your form fields, you can use the 
SELECT/OPTION tag pairing to restrict what’s accepted as valid data for any of the 
fields on your form. To do this, you’ll need more HTML markup. That’s the bad 


news. 


The good news is that the form validation framework can generate the HTML 
markup you need for you. All you have to provide is the list of data items to use as 
an argument called choices when defining your property in your model code. You 
can also indicate when multiple lines of input are acceptable using the multiline 
argument to a property. 

Apply these changes to your model code in the hfwwgDB . py file. 


youir lists of values 
"top \jo\A\r todt. 


['Falcate ', ' Triangular ', ' Rounded'] 
['Humpback', 'Orca', 'Blue', 'Killer 
['Tall ， ， 'Bushy 、 'Dense'] 

['Flat ', ' Small ', 'Moderate ', 'Large 


Beluga' , ' Fin', 'Gray ', ' Sperm'] 


location = 
fin type = 


'Breaking', 'High'] 

Switch oh multiple- 
lihe i h pui 

db.StringProperty(multiline=True) 


db.StringProperty(choices=_FINS) 
whale_type = db•StringProperty(choices:— WHALES) 
blow—type = db•StringProperty(choices:— BLOWS) 
wave 一 type = db.StringProperty(choices= WAVES) 


Use Y ouV， 
o-f values 

m 叫 Y ou，r 
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Tesr DriVq 


With these changes applied to your model code, refresh your web browser once more. 


YouV is ”0 七 
lookm^ 3 。。山 W 七丨七 s 
-Vuv\C-*bioy> 3 l) 


wove 


*too- 


■ __ 

Report a Possible Sighting 
_ : _ 、 ^ _ 


+ ! 、ht 

tp://localhost ： e0Sl/ C (Q^ Google 

Z3 》 

□3 5555 

Apple Yahoo! Google Maps YouTube 

» 


Report m Possible Sighting 


NqITIG^ Eagle -eyed Jack Jones 


Email ： ^j@hfwwg. o rg 


The 'Wdtioh” -field 

is how displayed 
multiple lihes. 


Date: Jan 6, 2011 



Location: Just off the coast - redly 


Fin type 
Whale type 


Wave type 


close to share. 




Triangular 

A 

T ■! 



Rn 

\ 



Bushy 

0 


Breaking 


^ Submit Sighting 



o-f -the “type’’ 
•fields how have 
dv-op-dowh sclc^iioh 

州⑶⑽ associated 

with therh. 


A 


Your form now looks great! Go ahead and enter some test data, and then 
press the Submit Sighting button. 


What happens? 
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checking log console 


Meet the "blank scrccw of death 


jj 


Submitting your form’s data to the GAE web server produces a blank screen. 

^oofs...*b^a*b ， s ^oi ^ ^ n t 側 1 / 


exat 七 h/ usc\r—(*v-'»cy\dlY* 




http://localhosreosi/ Google 


Apple Yahoo! Google Maps YouTube 


» 

» 


To work out what happened (or what didn’t 
happen), you need to look at the logging 
information for your GAE webapp. 

If you are running GAE on Linux, your logging 
messages are displayed on screen. If you are on 
Windows or Mac OS X, click the Logs button 
within the Launcher to open up the Log Console 
for your webapp. 




.s 


Clear 



CoogleAppEngineLauncher 


Q 


Deploy Dashboard 


HeadFirstPython/chapterlO/mygaetest 


hon/chapterlO/hfww 


Port 

8080 


8081 


Log Console (hfwwg) 


Qt Search logs 


Search 


*** Running dev_flppserver with the following flags: 

--■admini_console_server« --port^-S0Sl 
Python cormmflnd : /usr/bi n/py tihon2 ,5 

WARNING 2 | 3i0-l®-'34 jGGZ dat^store_file_stub a py :657]| Could not read dcitcistore data from /va r/f o l d e r s/Y3 / 

Y30Q jqItG0qNEwtHyBcJWk++4TI/-Tinp-/dev_-appserver, deltas to re 

WARNING 2013-10-^4 'SiSj 41dev_opp server. py: 3637] Could not initialize images API; you -are likely missing the Python 
''PIL 11 module, IrnportError: No module named .imaging 

INFO 2010 -10-*04 , 0Sj 41：'31 j 71? dev_appserver_maiin. py:431] Running application hfwwg on port S'SSl: http: //loc-alhost : B0B1 
INFO Mim 功 4 08:41:24,337 dev_appserver .py : 3275] ''GET / HTTP/1.1 11 2M - 

INFO 2QW-W-2A ^8:41: 24j 359 dev_flppserver-py : 3275] 11 GET /stfltic/styledform, css HTTP/1.1' 1 2 洲 - 

INFO 2&W-m-m 08:41:24,374 dev_appserver .py : 3275] 11 GET /stctic/hfwwg, css HTTP/1.1' 1 im - 

INFO 2^1^-10-04 ®Sj 44:27 1 423 dev_appserver .py : 3275] 11 POST / U11P/1.V' 4^5 - 


A 


Your request resulted in a 4 05 status code from the web server. According to 
the official HTTP RFC standards document, 405 stands for: 

“Method Not Allowed. The method specified in the Request-Line is not allowed 
for the resource identified by the Request- URL The response MUST include an Allow 
header containing a list of valid methods for the requested resource”. 


rouv 


last web V-C^ucsi 
Suited i h a ^ qc , 



Uwww... 七 Wts as 
as mud) *t **t? 
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scaling your webapp 


Process the POST withiw your webapp 

What the 405 status code actually tells you is that posted data arrived at your 
webapp intact, but that your webapp does not have any way of processing it. 
There’s a method missing. 

Take a quick look back at your code: the only method currently defined is 
called get () . This method is invoked whenever a GET web request arrives 
at your webapp and, as you know, it displays your sightings form. 

In order to process posted data, you need to define another method. 
Specifically, you need to add a new method called post () to your 
Sighting Input Page class. 


App Engine handles requests as well as responses 

Your get () method produces your HTML form and returns a web response 
to the waiting web browser using the self . response object and by 
invoking the out. write () method on it. 

In additon to helping you with your web responses, GAE also helps you 
process your web requests using the self . request object. Here are a few 
lines of code that displays all of the data posted to your web server: 


Listen, bud, Til happily 
process your web requests all 
day long...just as long as you 
give me the methods I need! 



p 如 c a … 


十’ 七 io use il scir with 

all youv- methods. 





youv- -fov 


def post(self) : 

for field in self.request.arguments() : 
self.response.out.write(field) 
self.response.out.write(' : ') 

self.response.out.write(self.request.get(field)) 
self.response.out.write('<br / >') 



丁 k value assotM 

^ovidcd ^ 咖 c. 


So.. .if you know the name of your form field, you can access its value from 
within your webapp using the self . request. get () method. 


But what do you do with the data once you have it? 
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storing data 


Put your data m the datastorc 

Your data is sent to your webapp by GAE and you can use the self . 
request. get () method to access each input field value by name. Recall 
the Birth Details model from earlier in this chapter: 


TWis code is m a ^\\t 

from google.appengine.ext import db 

tailed 


^ _ _ 

class BirthDetails(db.Model) : 


name = db.StringProperty() 


date_of birth = db.DateProperty() 


time_of_birth = db.TimeProperty() 


Assume that an HTML form has sent data to your webapp. The data is 
destined to be stored in the GAE datastore. Here’s some code to do the heavy 
lifting: 


HTML \rcsfoy\SC 

-bo say 


Send youv 
^respohsc io the 
wa'rtihg web 
bvowsev-. 


def post(self): 

new birth = birthDB.BirthDetails() 


Cvcaic a hew “BHhD 七 
objed -to hold youv daia. 


new_birth.name = self.request.get('name') 
new birth.date = self.request.get('date of birth' 

一 〆 一 一 

new_birth.time = self.request.get('time of birth')) 


new birth.put() 




^rry/s data values 
a 灼 dl 七 hew *to 

youv y\c>/ objects 
a 七七 viW 七 cs. 


html = template.render('templates/header.html', {'title': 'Thank you!'}) 
html = html + M <p>Thank you for providing your birth details.</p>" 
il = html + template.render('templates/footer.html ', 

{'links': 'Enter <a href= n / n >another birth</a>.'}) 

self.response.out.write(html) 


There’s nothing to it: create a new object from your data model, get the 
data from your HTML form, assign it to the object’s attributes, and then use 
the put () method to save your data in the datastore. 
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9 ^. 




Based on what you know about how to put your HTML form’s data into the GAE datastore, 
create the code for the post () method that your webapp now needs. Some of the code has 
been done for you already. You are to provide the rest. 


def post (self) : 


pu 七 y ouV ， 乙 0 ^ 


html = template.render('templates/header.html ', 

{'title * : * Thank you! *}) 

html 二 html + "<p>Thank you for providing your sighting data.</p>" 
html = html + template.render('templates/footer.html 1 , 

{’links 1 : 1 Enter <a href= M / ">another sighting</a>. '}) 

self.response.out.write(html) 
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post to datastore 



Based on what you know about how to put your HTML form’s data into the GAE datastore, you 
were to create the code for the post () method that your webapp now needs. Some of the 
code has been done for you already. You were to provide the rest. 


def post(self) : 




c 以…〜 ob 

丄 _L / • I 。 


hcw__si^lvt*m^.hair«c =■ sel-fvc^ues*t*yt^ 
new 一 siglvtir^.ein^il 二 scl-f.rc^ucs*tyt^CimailO 
hew^siglvt'mg.da-tc — sel*f.re«\uestyt('da*t〆 ） 
hcv^_si^lvtm3 *tii^c ― sel-f v-e^ues-tyt^tn^cO 



Pov- o( the data 
values YtU\Mtd -fvom 
the HTML 

assi 3 h them -to -the 


hcv^si^lrtm^.loda-tioh ==■ scl-f.vc^ucstyt^loda-tiohO 

WY/_si5him3-f'm_iyfe - sel^.»re^uest.3ei('-f'm_iyfe ， ) ^ Jbjeci 

hcy/^si^tmg.whalc^typc =■ self.re'uestje 七 
hCv^_si^h*t*m5.blov^_*typc —scl^.rc^ucst ^c*t^blow_*typcO 
hcv^_si^lvtm3>wavc_*typc — scl-f .request. yt^>wave__*typcO 

. ；' LX ； .…… 二 … r ?°? ulatcd 。'^ m 从 c _ 

⑽ y/_s^ 七七 U — aatas^c. 


html = template.render('templates/header.html *, 

{'title' : 'Thank you!'}) 

html = html + M <p>Thank you for providing your sighting data.</p>" 
html = html + template.render('templates/footer.html ', 

{'links': 1 Enter <a href= M / ">another sighting</a>. '}) 


self.response.out.write(html) 
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Tesr DriVq 


Add your post () code to your webapp (within the hfwwg. py file) and press the Back button on 
your web browser. Click the Submit Sighting button once more and see what happens this time. 

ttcvc 、 youv- 
fovw WrtVi 七 
data *to 

be suW ， 七七 cd. ㈣ Report a Possible Sighting 




+ 0 http://lQcalhost:80Sl/ C , \ Google 

CP £：：£ Apple Yahoo! Google Maps YouTube 




Report a Possible Sighting 


NoniG. Eag l€ -eyed J ac k Jo n€ & 


Email: ^gj@hfwwguorg 


But when you 匕 lidc 

the buttoh, somcth'mg 
bad has happ C hcd...youv 
webapp has cashed. 


Date： Jan 6, 2011 
Time： s ： 02 am 


Lg 

e o o 


http:// local host: S0&1/ 






+ 

http: //localhost:80Sl/ 

e 

^ - 

(Q, t Google 

F 


■ ■■丽 
■■■■ 

■■■■ 

Apple Yahoo! Google Maps YouTube Wikipedia PopyfarT 




Whal 

Bfoi 

Wav 


Traceback {most recent call last )s 

File " /Applications/GoogleAppEngineLauncher,app/Contents/Resources/GoogleAppEnginie-de 
handleE ： .post t * groups) 

Pile " /Users/barryp/EieadPirstPython/chapter 10 /hfwwg/hfwwg .py " ,■ line 27 1 In post 
new_slghtinig .date ■ 3elf . request* get^ 'date ' ) 

File ll! / Applications/GoogleAppEnglneLauncher. app/Contents/Resources /GooglcAppEngine-d£ 
value ■ self*validate{valued 
File /Applications/GoogleAppEnglneLaancher.app/Contents/Resources ( Goog1 gA ppEngIne-d£ 
value = supeE{DateProperty^ self)-validate{value) 
rile / Applications/GoogleAppEngineLaunicher. app/Contents/Resour ces /GoogleAppEnginie-de 

{self.name f self.data_type._name_ )} 

SadValueError s Property 'date must be a date 


oblem y/rbV) 七 V\C 




U 


Phooey—thafs disappointing, isn’t it? 

At the very least, you were expecting the data from the form to make it into 
the datastore. • .but something has stopped this from happening. What do you 
think is the problem? 
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conservative responses to liberal requests 


Pow't break the "robustness principle" 

The Robustness Principle states: “Be conservative in what you send; be liberal 
in what you accept. ^ In other words, don’t be too picky when requesting data of 
a certain type from your users, but when providing data, give ’em exactly what 
they need. 


If you make it too hard for your users to enter data into your system, things 
will likely things break. For instance, within your model code, consider how 
date and time are defined: 


/\ date, a^d NOTHING 
W 七 a da 七 c 如 11 do. 



date = db.DateProperty() 
time = db.TimeProperty() 


The trouble is, when it comes to dates and times, there are lots of ways to 
specify values. 



provide a 
valid value -foir time. 
A^ythihg else is simply 

WWACCEPTABLE. 
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Accept almost any date and time 

If you are going to insist on asking your users to provide a properly formatted 
date and time, you’ll need to do one of two things: 

• Specify in detail the format in which you expect the data. 

• Convert the entered data into a format with which you can work. 

Both appoaches have problems. 

For example, if you are too picky in requesting a date in a particular format, 
you’ll slow down your user and might end up picking a date format that is 
foreign to them, resulting in confusion. 

If you try to convert any date or time entered into a common format that 
the datastore understands, you’ll be biting off more than you can chew. As 
an example of the complexity that can occur, how do you know if your user 
entered a date in mm/dd/ yyyy or dd/mm/yyyy format? (You don’t.) 


There is a third option 

If your application doesn’t require exact dates and times, don’t require them of 
your user. 

With your sightings webapp, the date and time can be free-format fields that 
accept any value (in any format). What’s important is the recording of the sighting, 
not the exact date/time it occurred. 


^ouv-sc, wcbdpps 
hot be as dhd 

(lo 。 兄 with ahd times. 

Wch thdfs the tasc, you'll 
wed "to ircvcirt ohc o^f the 
ftiohs discussed cavliev oh 
七 his page ahd do the 
you 匕如 . 


Use "db.StriwgPropertyO" for dates and times 


If you relax the datatype restrictions on the date and time fields, not only 
do you make is easier on your user, but you also make it easier on you. 

For the sightings webapp, the solution is to change the property type for 
date and time within the hfwwgDB . py file from what they currently are 
to db.StringProperty(). 


date = db.StringProperty() 
time = db.StringProperty() 



I 七 、 a swsll 

Wb rt’U wake all 


Let’s see what difference this change makes. 
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test drive 




Tesr DriVq 


Change the types of date and time within htwwgDB . py to db . StringProperty (), being 
sure to save the file once you’ve made your edit. Click Back in your web brwoser and submit your 


q^/ ^ 0 ||^ sightings data once more. 

1 c 七 、七口 

*tWis a —灼. 

Report a Possible Sighting 


http://localhost:80Sl/ 


C (O^ Google 


m 


Apple Yahoo! Google Mapi YouTube 


» 

» 


Report a Possible Sighting 
Name 


^ ^ ^ 


H appear -to 
have worked -this ii 

me. 

I 

Thank you! 


http://local host :80 SI/ 


C [Qt Google 




Email 

Date 

Time 

Location; 


Eagle - eyed Jack Jones 
fcej@hfwwguorg 


Apple Yahoo! Google Maps YoyTube 


» 

» 


Jan 6, 2011 


8:02am 


Thank you! 

Thank you for providing your sighting data 
Enter another sighting. 


Lrt、cyrtcv ay\o*t^cv 
just *to be 

suve. 、 


Just off the coast ， really 
close to shore. 


^ f % Report a Possible Sighting 

+ 

ri http://localhost:60Sl/ C 

Google » 

CD 

£：：£ Apple Yahoo! Google Maps 

YouTube 


Triangular 


Fin 


Fin type: 

Whale type: 

Blow type: 

Wave type: Breaking 


Bushy 


〔Submit Sighting J 


Report a Possible Sighting 



Mary KdiahtY 
fnfey@Hifwwg.org 
Wed Jan 12, 2011 


Off Lighthouse Rock, looking 


north-east. 




Fin type: 、 Rounded 


Whale type: . or<=a 


BlOW type ： , D^nse 


By relaxing the restrictions you placed on the types of data 
you’ll accept, your webapp now appears to be working fine. Go 
ahead and enter a few sightings by clicking on the link on your 
thank-you page and entering more data. 


Wave type ； Moderate 


(^Submit Sighting J 
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scaling your webapp 


With a few sightings entered, let’s use App Engine’s included developer console to confirm that the 
sightings are in the datastore. 

To access the console, enter http : / /localhost : 8081 /_ah/admin into your web browser’s 
location bar and click on the List Entities button to see your data. 


Ann 


+ ^ ^ h»p;/havt. SOai/dh/iijJmi n/djUilprfiTkindl-SiglT 


m Apf>lr VAhao 1 Gjaaglr- Mnpi Y-nu I ubf Wikip^did Pnpul 


CcK^le 1 App Engine 

hfwwg Development Console 

Datastore Viewer 


□ilaslQr# Viewer 

ifvieractive Cor^e 

Vifin^br 

Taa k Queues 



JlA d f ，tioh ^ vicwih 9 y°^ daia m the 
& you d " - ^ ^ 


hew 


hFwwg Development C&nsole - Data 伽 re Viewer 


C \ (Or Goggle 


Entity Kind 

Sighlirtf] m ^ I ■访 Ijitifif t [ Intitv 

Se^eci ^am&^&ace 


Cron Jotefi 

□ 

ID 

Key Mam« blow_typ€ 

d 伽 

email 

XMPP 

□ 

aaVcZfM33. G 

Bushy 

Jan 5, 2011 

«l@hfwwg.or9 

lfr|?gynd Mail 

□ 

naVo2iTHj3.. 7 

DtmfUi 

Wnd, 

12, 5011 

mky@hfM\ug wg 


□ 

Bgyv£miJ3,n 0 

Tdl 

Fubnury 20, 
Mil 

2/Mar/2011 

j|ninny@£ii|^.cum 


u 


Bushy 

no&@z ep.com 


CDriKiV^ - ^ 





fi n_typ# 

Ti^ai^guiar 

Rmifulnd 

FifcatB 


Veeahon 

Just off the coast * 
reafly clo^e to shore. 

Off Liighthflufifi 
looking north-fiasl 

Lvuhing ill 
Smu^glur'ii Cwn. 

Muty iMoyntain Bay. 


Eagle-eyeO 
Jack Jones 

iMin^y Knlghly 
Jitm w Ph^u 
Bob Pliant 


tim# 

&:02am 

i-iirly, -tiL 
dawn, 

flLfllSpm 


wave_lyp< 

Bnaakitig 

Flart; 


Rftftulln 1 -4 of 4 


wha'le_ 

Fin 


Orr.>i 


G'dv 


Humpback 

i 






A 


士， 7 ou\eea t> u^uclv a 衅 M 


TWe s a *l daia youv ded, which 
' S，hd s ' ； 9 htl y oYdtY ihah what 

K u But \i l s all ih 

sW y° u ^ P ， ti« m 

alphabetic! ovd ⑺ by 


Your GAE webapp is now ready for prime time. 

Before you deploy it to Google’s cloud infrastructure, let’s run it by the folk at 
HFWWG to see if they are happy for their webapp to “go live.” 
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restrict to registered users 


It looks like you're wot quite done yet 



Man, thafs looking good! 

There's just one thing we forgot 
to tell you... we are worried 
about spam and need to be sure 
only registered users can enter a 
sighting. Is that a big change? 



Is this a big change? 

You would imagine that it would be. You’ll have to create an new entity to 
hold your registered user login information, and you’ll also need another form 
to ask users to provide their registration data (which you’ll need to store in the 
datastore). With that in place, you’ll need j 以 another form to ask your users to log 
in, and then you’ll have to come up with a mechanism to restrict only registered 
and logged-in users to view your webapp’s pages, assuming you can come up 
with something robust that will work...? 

Or...as this is GAE，you could just switch on authorization. 
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Sometimes, the tiniest change can make 
all the difference... 


The engineers at Google designed App Engine to deploy on Google’s cloud 
infrastructure. As such, they decided to allow web app s running on GAE to 
access the Google Accounts system. 

By switching on authorization, you can require users of your webapp to 
log into their Google account before they see your webapp’s pages. If a user 
tries to access your webapp and he isn’t not logged in, GAE redirects to the 
Google Accounts login and registration page. Then, after a successful login, 
GAE returns the user to your waiting webapp. How cool is that? 


To switch on authorization, make one small change to your app . yaml file: 



That s 』 theve 
is "to i-fc. 


r> n 

Login 



+ } s http : / / local hos t : 6 0 S 1 /a h /1 o <5 

(Q, t Google 


Apple Yahoo! Co-ogle Maps YouTube 

Wikipedia » 





TWis is V^ov/ lo^'m 

looks i\\t 

七 CS 七 

youv 


Not logged in 


Email ： te &t@examp(e. com 

□ Sign in as Administrator 

(Login ； ::、 Log out 〕 
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log login info 


Capture your user’s ftoogle IR too 


Now that your webapp requires your users to log in, let’s arrange to capture 
the user login information as part of the sighting. 

Start by adding the following property to your entity’s list of attributes in your 
hfwwgDB . py file. Add it right after the wave_type property. 


Orcait a 
a 七 *br’iW 七 c … Y ou，r 
class … 



...ahd set its 
piropcirty typ c . 


Let’s ensure that Django’s form validation framework excludes this new attribute 
when generating your HTML form. Within your hfwwg. py file, change your 
Sigh ting Form class to look like this: 


Make suv-c Pja^^o 
doesn't mtludc 
七 he a 七七七 c 


m youv- y 敵 a 七 ed 


class SightingForm(djangoforms.ModelForm) : 


class Meta : 

model = hfwwgDB.Sighting 
exclude = ['which user'] 



Staying within your hfwwg. py file, add another import statement near the 
top of your program: 


from google.appengine.api import users 





—W ^AE's 
Auo^is 
API. 


In your post () method, right before you put your new sighting to the 
datastore, add this line of code: 



Every time a user adds a sighting to the datastore, GAE ensures that the user’s 
Google Account ID is saved, too. This extra identification information allows the 
HFWWG to track exactly who reported which sighting, and should (hopefully) cut 
down on the amount of spam your webapp might attract. 


七 Wis todt mtludcs 

七 6{00(^t IP 

lo^cd-m usd 


All that’s left to do is to deploy your webapp to Google’s cloud. 
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Peploy your webapp to Google's cloud 

With your webapp developed and tested locally, you are now ready to deploy 
to the Google cloud. This is a two-step process: register and upload. 

To register your webapp on the Google cloud, click the Dashboard button 
on the GAE Launcher. 


The butU opehs 

C w <rb birowseir a h d iakes you 
to the >y Appkatiohs w 
you sia h lh 
一 google Ip). 


o o 






CoogleAppEngineLauncher 


£ 


Q 


Run Stop Browse Logs SDK Console Edit 


Deploy Dashboard 



Name 

mygaetest 


Path 


/ Users/barryp/HeadFirstPython/chapter 10/mygaetest 


/Users/bar 


hon/chapter 10/hfww 


Port 

8080 


8081 


^T 


Qy\ use 

必 ri 汁伤 

dcfloY. 


« o o Create an Application 

(_ ) ( 、*) ( http://appengine.google.com/start/createapp 


☆ ▼ seventh inning stretch 




BBC News 為 RTt News 灸 G-Mail O'Reilly Radar 免 Head First Labs 免 LJ - Front 兑 LJ - News 為 Safari CNews Ireland ^ Twitter TT: 2010/2011 


Create an Application 


Jioogle app engine 

Create an Application 

You have 7 applications remaining. 

Application Identifier: 

.appspot.com Check Availability 

You can map this application to your own domain later Learn more 

Application Title: 

Displayed when users access your application. 


I Mv Account | Help | Sian out 


youv webapps hdme ih 
xKc box, thch ^li^k oh -the 

CWk Availability' birtto h 


po^-t use as 

七 hat’s already take”. ® 


Authentication Options (Advanced): Learn more 

Google App Engine provides an API for authenticating your users, including Google Accounts\3oogle Apps . and OpenID. If you choose to use this feature for some parts of your site, 
you'll need to specify r>ow what type of users can sign in to your application: 

Open to all Google Accounts users (default) 

If your application uses authentication, anyone with a validGoogle Account may sign in. (This indues all Gmail Accounts,but does # r>ot* include accounts on any Google Apps domains.) 
Edit 


Create Application Cancel 


0 ? Wall 7 , a 拙十 哪 W 如 

c\\cV “Ocatc W 七 

◎ 2008 Google | Terms of Service | Privacy Policy | Blog | Discussion Forums 


Done 



Assuming all went according to plan and GAE confirmed that your 
application has been created, all that’s left to do is to deploy. Return to the 
GAE Launcher and click on the Deploy button. The console displays a 
bunch of status message while the deployment progresses. If all is well, you’ll 
be told that “appcfg.py has finished with exit code 0’’. 


Your GAE webapp is now ready to run on Google’s cloud. 
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test drive 



Let's take your webapp for a spin on Google’s cloud. Open your web browser and surf to a web 
address that starts with your we bap p's name and ends in .appspot.com. For the HFWWG webapp, the 
web address is http://hfwwgapp.appspot.com. When you first attempt to go to their webapp, App 
Engine redirects you to the Google login page. 




Coogle Accounts 


O 


0 , 〔 C ?) 〔 _)(^3 9009le.c0m~~https://www.goog ^4 ’ Google 


Q 


BBC News Sv RT 在 News Sv G-Wlaif O r Reitly Radar 兑 Head First Labs ^ LJ - Front 免 LJ - News 5^ Safari ClMews Ireland 免 » 
I Google Accaunts 



Google accounts 


HeadFirst Whale Watching Group uses Google Accounts 
for Sign In. 

Google is not associated with Ehe contents of HeadFirst Whale Watching Group or its 
owners. If you sign in, Google will share your email address with HeadFirst Whale 
Watching Group, but not your password or any other personal information, 

HeadFirst Whale Watching Group may use your email address to personalise your 
experience on tfieir website 


Pvovidc 70 UV ^oo^lc IP 
yassY/ord, or uf d 
^oo^le M you do^ t 

V^avc ov\t alrcadY). 



Sign in with your 

Coogk Account 

Email: 

e.g. pat@example.com 

Password: 

M Stay signed in 
Sign in 

Carft access your aocmjnt? 



Don't have a Google Account? 
Create an account now 


©2010 Google - Google Home - Terms of Service - Privacy Policy - Help 


Done 
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After a successful login, your sighting form appears. Go ahead and enter some test data: 


^ ^ Report a Possible Sighting 

® '五 1 一 ' 


BBC News 

The sewed —> | D , 

i?\row i\\c ^oo^lc cWd is 
e/ACTLV same as 
sev-ved by Y ouV " 
scv-vc\r. 


為 RTt News 免 G-Mail O’Reilly Radar Ks 
Report a Possible Sighting + 


» 


Report a Possible Sighting 
Name 







google.com https：i 


BBC News 兔 RTt News Sv G-Mail O’Reilly Radar 免 Head F 
Data Viewer - Head First Whale Wa . . + 


Google app engine 


hfwwgapp 二 J Version: 

Main 

Dashboard 
Quota Details 

Logs 

Cron Jobs 
Task Queues 

Blacklist 

Data 

Datastore Indexes 


Email 

Date 

Time 

Location 

Fin type 
Whale type 
Blow type 
Wave type 


Jonathon Baldwin 


jpj@zep.com 


Mar 3, 2011 


11:59am 


At Bluffer 1 s Beach, 
about 50m from shore. 


Keiu^ io the hU P ：// appch9ihC . 9oo9 , c 
• 7 ^ ^ h ^ ^ ^solc. The Ul 

i S 1 l，Ulc icsi 

but you ^ use ihe 1 /icw^ h> 

f ”鈍 y° “ 鈍 “as b 咖 sW d 


Triangular 

:! 


Cray 



Tall 



Moderate 

A 

▼ 

^ Submit Sighting J 


Query 


Create 


By kind: Sighting 二 J kintte Do 

田 Options 


ne 



j Mv Account | Help | Sian out 
« Mv Applications 




Sighting Entities 


^Datastore VieweP\ 

Datastore Statistics 

Blob Viewer 


Administration 
Application Settings 

Permissions 

Versions 
Admin Logs 


<Prev20 1-1 Next 20 > 

□ ID/Name 

blow 一 type 

date 

email 

fin_type 

location 

name 

time 

wave 一 type 

whale 一 type 

which_user 

□ id=1 

Tall 

Mar 3, 
2011 

jpj@zep.com 

Triangular 

At Bluffer's 
Beach, about 
50m from 
shore. 

Jonathon 

Baldwin 

11:59am 

Moderate 

Gray 

hfpython 





Clidk oh this lihk io see 
youir daia as sWcd ih 
the google doud. 




1-1 Ne: 


Done 
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a winning webapp 


Your HFWWft webapp is deployed! 


rm all packed up and 
ready for a weekend of 
whale watching. I caiVt wait 
to enter my sightings 
data online! 


O 

o 



This is professional work. 


0 


o 


This is waaaay cool. Look 
at that fabulous webapp. 
This is exactly what we 
need. Super work! 



You’ve built a great data-entry webapp and deployed it on Google’s cloud. No 
matter how busy things get, whether there’s a handful of sightings per day 
or tens of thousands, jox/r webapp can handle the load, thanks to Google’s App 
Engine. And, best of all, the cash-strapped HFWWG doesn’t pay a penny 
until their sightings activity reaches the level of millions of sightings per 
month! 


P"id Vou 七 ha 七 

you y/vo 七 c all J 7 ou，r 

Code 2 -.^? 
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Your Pythow Toolbox 

You’ve got Chapter 10 under your 
belt and you’ve added more great 
Python technology to your ever- 
expanding Python toolbox. 


used 


^ ^patasW^ - data ^ 

b Y ^oo^lc A?? ^ ^ • 一 ㈣ 

s*tov*c y 。 价 da*t3. 

@ : / 一如一 c used ^ a w 

data". ^ 

魯 Tro^-t/ - used U a w data 

value". 


■ Every App Engine webapp must have a 
configuration file called app. yaml. 

■ Use the GAE Launcher to start, stop, 
monitor, test, upload, and deploy your 
webapps. 

■ App Engine’s templating technology 
is based on the one use in the Django 
Project. 

■ App Engine can also use Django’s Form 
Validation Framework. 

■ Use the self. response object to 
construct a GAE web response. 

■ Use the self. request object to 
access form data within a GAE webapp. 

■ When responding to a GET request, 
implement the required functionality in a 
get () method. 

■ When responding to a POST request, 
implement the required functionality in a 
post () method. 

■ Store data in the App Engine datastore 
using the put () method. 
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本 Data wrangling ♦ 



It’s great when you can apply Python to a specific domain area. 

Whether it’s web development, database management, or mobile apps, Python helps you 
get the job done by not getting in the way of you coding your solution. And then there’s 
the other types of problems: the ones you can’t categorize or attach to a domain. Problems 
that are in themselves so unique you have to look at them in a different, highly specific way. 
Creating bespoke software solutions to these type of problems is an area where Python 
excels. In this, your final chapter, you’ll stretch your Python skills to the limit and solve 
problems along the way. 


this is a new chapter 
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pace data 


Whaf s a good time goal for the 
wext race? 


The Head First Marathon Club has spent years collecting and 
collating data on their distance runners. Over time, this 
data has helped the club produce a large spreadsheet of pace 
data that helps their runners predict their performance over 
various distances. The spreadsheet is huge and runs to 50 
columns of tightly packed data. 

Let’s take a look at the club’s data, as well as the way the 
runners and their coach use it. 


a d 如 Marais 

Club’s sf\rcadsV)cc*b da-ta. 



File Edit Via* - insed Format Form Tbds Help 




TV\c fv-cd'it*tcd 
wav-a*bV)oy\ 50a! • 


1 (1 

tr. ^ 

$ ^ 123 ▼ 1 » 1 C ^ 

horni 



ule: |vd2 





ft. 

B 

C 

D 

£ 

F 

75.E 


術 ^ i 


32.S 

B1.1 

7fl.3 

j^5 




2 

S 

4 

5 

加 i 

a：dD 

3：U 

B：S1 


B：44 

ft: 洲 

ah 

12:49 

1 

13:24 

13:42 

14:00 

14:19 

5ft1i 




Z2：47 

iSLia 

2)：5C1 


26:54 

27:30 

ZE：M 



SD：€4 

U 

9 

ID 

r 


4l：3l 


43:24 

- ( 

45:2^ 一 

45：Z4 

、imnT 

44M 


卵:别 

«7：51 


5D: 啦 

通 

SC:24 

57:45 

59： N 

1L«：S 

1；D1：45 

1:43 ：0B 


胡:财 

1:01:01 

1:QZ:32 

1l03:S£ 


1: Si 

25h 






1 ： 2lh：10 

Mfc 



1:31:04 


^tts3TTT^ 

1 ： 3T：26 

Marathon 

2：05：U 

2：0Bi：24 

2:11:1? 

Z：14： IS 

Z：1T：16 r 

2:2lh:Zl 

13 




^ - 
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dealing with complexity 



v/cs, S^cs W»tkcd fast! 


I run the 15K in 45:01. My 
coach looks up the closest 
match for my time along the 
15K row. 


This benchmark allows me 
to look up or down the column 
to select a target time for 
any other distance, such as a 
marathon, for example. 


o 






This is a liiii c 

卞 do/i wo ^ v . 

y° u II sovi it oui 


sooh. 





H 

1 


J 


K 


L 








TAJ ： 

72.5 

70.9 


69.4 


6T.& 




54.9 


E3i.S 

E 



9：oa 

■9:20 

9:33 

苷:牝 

S:S 9 

1D：13 

10 ： 2]6 

1&：41 

1 


u: 加 

14: 邪 

1S. ： 1E 

1S：39 

16:DQ 

16^2 

15:44 

ITlK 

1 


24:22 

24 ： S5 

2JS：ZB 

26 ： D3 


27-14 

2fl5t 

2B ： 2S 

i 


34:43 

31:25 


32:52 

扣:筘 

]4:Z2 

as【w 

35 ： 5>G 

" 


47 ： Z7 

4B：31 


Sh43 

Sl:52 


54:14 

55：27 

H 

h 


bi'M 

51:1 E 

5^:29 

54 Ml 

Sfi:S5 

S7:11 

5B ： 2S 

59：47 

1 


1 ： €4：33 

1: 仳 ■叩 


1 卿 : tn 

1:10:34 

1:12 着 

1:114& 

1h15>:2JG 



i ： aa：£il 

i ： (ra.53 

1:11:23 

i ； l3：iM 

1jU ：43 

1 ： 1E：24 

l：i sm 

11 Li 9：52 

1 


1 ： 2i ： 5E 

1: 妇 :49 

l.lZS-itfl 

i ： 2T ： i7 

1:29 : 泌 

1:31:37 

1 出 :4JD 

1115:47 

1 


1 ： 3i ： 3f 

1 ： 41.5Z 

f:4lCT9 

ima 

1 ： 4B：54 

1:51:21 

1:53:51 

1lS5l2S 

1 


2:23:31 

1\2A:44 

£ ： 3C) ： Q2 

之:尨 ：25 

2 宓 5:51 

Z.4Di：24 

ZM：€0 

2 ： 47：42 

S 
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rain delay 


So...whaf s the problem? 



At the moment, we print our data onto 
multiple sheets of paper, which we carry with us. 
Most of the time, this works fine. But when it rains 
or gets really windy, our pages are either soaked 
through or they end up all over the place. 


All these sheets avc 

a P3ih...csp^ially i h 
the vaih. 







Not to mention: forgetting the sheets, keeping the sheets up to date, and 
having to flip back and forth through the sheets looking for a closest match. 

Of course, word of your newly acquired Python programming skills is 
getting around, especially among the running crowd. Ideally, the Marathon 
Club needs an Android app that can be loaded onto a bunch of phones and 
carried in each coach’s pocket. The app needs to automate the lookup and 
distance predictions. 


Are you up to the challenge? Do you think you can help? 
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Start with the data 

For now, let’s not worry about creating the Android app; you’ll get to that 
soon enough. Instead, let’s solve the central data wrangling problem 
and then, when you have a working solution, we’ll worry dhout porting your 
solution to Android. We’ll begin by getting the data into a format you can 
easily process with Python. 

Most spreadsheet programs can export data to the widely used CSV format. 

The club has done this for you and created a file called PaceData . csv, 
which includes the data for each of the rows from the original the spreadsheet. 

Here’s a sample of the raw data from the start of the CSV: 

TW ^ Ime dala is tjje ^ 嘗 

like 时 atWIv H 上 e “ 心 M 

data, .ell j-t W V, e aa，^ 



fills! 


Grab a copy of 
PaceData . csv from this 
book’s support website. 


3 84.8,82.9,81.1,79.3,77.5,75.8,74.2,72.5,70.9,69.4,67.9,66.4,64.9,63.5,62.1,60.7,59.4,58.1,56.8,55. 
8:00,8:10,8:21,8:33,8:44,8:56,9:08,9:20,9:33,9:46,9:59,10:13,10:26,10:41,10:55,11:10,11:25,11:40,1 
.2:49,13:06,13:24,13:42,14:00,14:19,14:38,14:58,15:18,15:39,16:00,16:22,16:44,17:06,17:30,17:53,18: 




f value o, o-f the ^csi 

the lm« is the timed disiau c 
OV* vow label. 


d d W a Id of corded 


\ruv\ 


-times. 


parpen your pencil 


You somehow have to model the data from the CSV file in your 
Python program. Can you think of a data structure that might 
help here? Justify your selection. 
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multiple associations 


^ Sharpen your pencil 
、（Solution 


You somehow have to model the data from the CSV file in your 
Python program. You were to think of a data structure that might 
help here? You were also to justify your selection. 


The lis*t of head'm^s be s-tov-cd'm a LIST. 

The lis*t of -from eddh vow also be stored *m a L|£T, bu 七 *thcy 

-b^eve s lots ^ also v\ttd bo be assodia*bed y/i*th *thc hcad*m<\s'm very -first voy/ c^f 

-bo 七 Wmk . 

about V^cv-c. data, so maybe a DICTIONARY is needed here? 




Maybe i-t^s some COMBINATION -the *two?|? 


Take another look at the data 


The first row of data in the CSV file is the column headings, with the 
very first value on the line, the VO 2 string, being redundant (it won’t ever be 
used in this version of the app). The rest of the first line’s data are headings 
associated with the time values in each of the columns. 


Of course, the data in the columns is also associated with each row, which is 
identified by a row label in the first column, such as 2mi, 5 k, and so on. 


Let’s look at the data in the CSV file again, which has been reformatted to 
help highlight the associations. 


TW，s is 


TV^c toluwm hcadi 扒 y arc 


TV \row labels 

-to ^ow 
of times. 



"Hjc times Oh irow arc associated 
W.th thc.ir ^ow label, but ALSO with a 


But can we capture all these associations in code? 
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Wat heeds 


Maratkon Magnets 

Here’s some code that reads the raw data from from the CSV data 
file. The column headings from the first line are loaded into a list 
called column_headings. The rest of the data (all the rows of 
times) are loaded into a dictionary called row—data, with each row 
of data keyed with the row label string from the start of each line. 
Of course, as luck would have it, someone was cleaning the fridge 
door, and they’ve left a bunch of magnets on the floor. See if you 
can arrange the magnets into their correct order. 


to 90 hcv-c 



with open('PaceData.csv') as paces : 


Pv-otcss 

1 ’IS 七 


for each—line in paces : 

Pv-O^CSS 

Vow__daia w . —- ^ ^ 
hcvc. 


num_cols = len(column_headings) 
print(num_cols, end= 1 -> ▼) 
print(column—headings) 

num_2mi = len(row_data['2mi*]) 
print(num_2mi, end='-> ') 
print(row data['2mi 1 ]) 


num_Marathon = len(row—data['Marathon *]) 
print(num Marathon, end='-> ') 



the dS'ia 
loaded, this Code 
^ you 如 Krt， s 

all 0^ 


print(row_data[* Marathon 1 ]) 
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Maratkon Magnets Solution 

Here’s some code that reads the raw data from from the CSV data 
file. The column headings from the first line are loaded into a list 
called column_headings. The rest of the data (all the rows of 
times) are loaded into a dictionary called row data, with each row 


of data keyed with the row label string from the start of each line. 
Of course, as luck would have it, someone was cleaning the fridge 
door, and they’ve left a bunch of magnets on the floor. You were to 
see if you could arrange the magnets into their correct order. 


row data 


U 




Oca 七 c 七 he 

乙 oluwm 

ImC 

delete the -Pivs-t 
heddihA ； the 
yoz\br\ 


with open('PaceData.csv') as paces : 



column headings•pop(0) 



for each line in paces : 


y\ccd i-t. 


v-ihg—you doh’t 


々 Read a I'mc -f'row »*t 

of 飾 a 士 dl 七 ^ 

s?lrt 从 c o” to 州州 a. 

P^css the ^esi o( the -Pile. 


v-ov/ label. 


row = each 一 line•strip().split( 
— 一 

row label = row•pop(0) 


row data[row label] = row 



num_cols = len(column 一 headings) 
print(num_cols, end= 1 -> ') 
print(column headings) 


^ Its 栋 c same dcaUc 代： 

^ take l*mc, \i> 

七 he” split OY\ towwa. 


the vow label 
"togc-thev with -the 

J the lihes daia to 
update the du^tiohdv-y. 


num_2mi = len(row—data[’2mi 1 ]) 
print(num_2mi, end 二 ’ -> ’） 
print(row—data['2mi*]) 


num_Marathon = len(row_data[ 1 Marathon *]) 
print(num_Marathon, end= 1 -> ') 
print(row—data['Marathon 1 ]) 


404 Chapter 11 





















dealing with complexity 


>» 


row data = {> 

with open( f PaceData,csv p ) as paces : 

column_headings = paces.readline().strip().split( 1 , r ) 
coIumn~headings.pop(0) 

for each 一 line in paces i 

row = each_line.strip().split( r f 1 ) 
row_IabeI = row.pop(0) 
row~data [ row_Iabel ] 二 row 

num_cols = len (coluinn_headings ) 
print (num_cols f end= f — 1 ) 
print (column_headings) 

num_2mi = len (row_data [ ' 2mi r ]) 


Py-hon 3.1.2 (r312:79360M, Mar 24 2010 f 01:33:16) 

[G ZC 4.0.1 (Apple Inc. build 5493)] on darwin 
Tvpe 11 copyright 1 ', 11 credits 11 or ""license( ) 511 for more information 
================================ RESTART ================== : 



Tesr DriVq 


Load your code into IDLE and, with the CSV in the same folder as your code, run it to see what you 
get on screen. 


marathort^py - /Users/barryp j HeadF i rstPython/chapte rl 1 /mairatho n ,py 


Vouv todt 
ih 、 




"Uc output 
七 V>a 七 tat\\ o-f 

da*ta ^0 da*ta 
•i 七 ews. 


丁 1^ 匕 olumh 
hcddih^s 



Tk w W ， 

v-ov/ o-f - 

data 


,1 



The 

irow o-p 

data 


Ln: 9 Col: 4 














0 3 0 


Python Shell 


That’s a great start: you’ve managed to read the data from the CSV and put 
the headings into a list and the data into a dictionary. 

What’s next? 
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link data structures 


0 


Did you forget to associate 
each time on each row with its 
heading? At the moment, the 
list and the dictionary are 
disconnected... 



Yes, the two data structures should be linked 

At the moment, the column— headings list and the row_ 
data dictionary are not linked in any way, and they need to 
be. What we need is some way to connect each of the times in 
each row with the heading that tops their column of data. 

What options do you have here? 

When it comes to linking (or associating) two data items with 
each other, the Python dictionary is the data strucutre of 
choice, isn’t it? 
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dealing with complexity 


Store each time as a dictionary 


Rather than simply storing each time in the row_data dictionary as a 
number, let’s store the data as as a dictionary, with the key set to the time and 
the value set to the column heading. That way, you can quickly and easily 
determine for any time which column it is associated with, right? 

Here’s a portion of what the data structure looks like in Python’s memory 


once this association exists: 

TV^c 一 dab 




^ o-r d smglc time value, 

(ow i 七加 is how 洳 di ^ ioha 

that 仏七 《 — with its 7 

乙 olurrm heddih0. 





All you need to do is work out how to populate the inner dictionary with the 
row data and the associated columns headings...and you’ll have all the data 
you need. 

The trick in creating the data structure is to realize that each row, including 
the column headings, are of a fixed size: 50 items. Knowing this, it’s not much 
work to create the dictionary you need: 


Ko 乩 a 呼 s 
av-c needed 

\\CrC 


empty di 匕 iiohdvy. 


]/\/\i\\ caA i*bcv-at»oy\, 
toluwm nurwbev"- 


row data = {} 

^ith open ( 'PaceData.csv') as paces : 

column—headings 二 paces.readline() .strip() .split ( ’， ， ） 
column—headings•pop(0) 
for each—line in paces : 

row = each—line.strip()•split (',，） 
row—label = row.pop(0) 
inner— diet = {} 

for(i)in range(len(column—headings)) : 

'inner_dict[row[i]] = column— headings[i] 
row data[row label] = inner diet 




Let’s hot havd- 
toAt the 

value ihstcad. 





f\ssot\ait *tV^c 

…狀七 & 
value -fv-ow 七 he 


\ro>w- 
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idle session 


r / V / An IDLE Session 



Go ahead and add the extra dictionary populating code to your program. Let’s remove all of those print () 
statements from the end of your program, because you’ll use the IDLE shell to test your code. Run the code by 
pressing F5 or by selecting the Run Module option from the Run menu. Use the dir () BIF to confirm that your 
program code executed and that a collection of variables have been created in Python’s namespace: 


»> dir () 

[' builtins_' , '_doc_' , ' name ' , 

inner 一 diet 1 , 'paces ', 'row ', ' row_data 


—package— 
row label 1 ] 


'column headings ', 'each 一 line 1 , 'i', 

AH youir Codes vaHablcs exist ， 


V02 




70.3 

沈 5 I 


加 ii 

a : 叩 

a：io 

E:Z1 n: 


B：44 


1Z ■柳 

13: 柿 

13 ： 24' \ 

13e4S 

14：00 

Sflli 

- 


ZZ ： 1T ) 

ZZ：47 

ZL 


26 ： & 4 




ZB>:45> 



^1-31 




44 : 妇 



44M 



47 ： 5T 

批挪 



SF.45 ( 

59：^^ 


V.M'M 



1 ： D1 ： 0f 

Trt±r3l 

1: 的:別 

1l«:23 






i ： ie ： z^ 

30h 

* 


1:31 ：M 

imi 

1:15:17 

Marathon 

Z ： D5：U 

2m\2A 

2:11 ilf 

2 ： 14 ： IS 

2 ： 1T：16 








Take another look at (part of) the spreadsheet data file above, and let’s try and find the column heading 
associated with the 43:24 time on the 15k row. Let’s then use the column heading to find the predicted time for a 
20k run: 


»> column—heading = row_data [' 15k' ] ['43:24'] 

>>> co^ea di n L ^ dol _ ^ lS —Jl.l，，. 

b 丄•丄 


»> prediction = [k for k in row_data['20k'].keys() if row_data['20k'][k] == column—heading] 
»> prediction 

['59:03'] 


A o-P Kt y^ ： OV ， is toYYtdVj pircdidtcd, hx 
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dealing with complexity 


Pisscct the prediction code 


Let’s take a moment to review what just happened at the bottom of the IDLE 
Session from the last page. This line of code is a double-dictionary lookup on the 
dictionary-of-dictionaries stored in row_data: 



A^d this is dho'thcv" 
di 匕 tiohdlry key, 
whi 匕 h ihdexes ih-fco 
七 he di 匕 tiohavy 4 

Vow^da-bf'/^k'J". 


1 ook UP -b^c ' 1 ^ vov/ data, look u\> 
lvalue assorted ^ ^ 


Working out the predicted time in the 20k row of data involves finding the 
key in the row’s dictionary whose value is set to the just-discovered value stored 
in column heading. 


/。“代 ih Wtcd ohly i h dais i^ai 

satis+ics this dohditiohal. 



TW.S \S i\st data youVc 


A conditional list comprehension is put to good use here. Recall that the list 
comprehension syntax is a shorthand notation for a for loop. The loop searches 
through the data in the list of keys associated with the dictionary stored at 
row—data [ ' 2 0 k' ]. If the value associated with the key (in k) is the same 
as column—heading, the value of k is added to the comprehensions results, 
which are then assigned to a new list call predictors 


There’s really an awful lot going on in that comprehension. 
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list comprehension 



Sweet mother of all things 
Python! Whafs going on 
here? I think my brain is 
going to explode... 


Don’t let the list comprehension put you off. 

Recall that you can always rewrite a list comprehension using 
an equivalent for loop … 

Ummm.. .now there’s an idea. 
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dealing with complexity 


r^Sharpen your pencil 


Rewrite each of the list comprehensions on this page to use a for 
loop. 


times = [t for t in row data['Marathon'].keys()] 


headings = [h for h in sorted(row data['lOmi'].values (), reverse=True)] 


time = [t for t in row data['20k'].keys() if row data['20k'][t] == '79.3'] 
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for loop 


^ Sharpen your pencil 
、、 Solution 


You were to rewrite each of the list comprehensions to use a for 
loop. 


times = [t for t in row data['Marathon'].keys()] 


StarU 舳孙 - > times =1 □ 广 

cwp 七 Y list .di 匕 tiohavy’s keys 

-for *m \row_da*tarMara*thoh’].keYsO: a lis-t. 


■bir^es.app ⑶ d(eadh_ 七） 

cacM iteration, append *b^c key (y/Wi^ is a 
value) or^'fco *t^C ''tiw'CS list 

headings = [h for h in sorted(row data['lOmi'].values (), reverse=True)] 


S*ta\r 七 y/i 七 V) a 灼 

cwfb/ l |S t. 


headings =• □ Tu\rh the d'ui-tioha\rys values ih-to a list … 

-for h *m so\rted(roy/_da*tariOmi’].\/alues0, reverse 二 True): 

head ^ t (b^t -fix m 


iVrth cadh i 七 eva 七 _o〜append -the value (whidh is a 

匕 olur»m hcadmj) oi^-fco ihc “"times” list 


time = [t for t in row data['20k'].keys() if row data['20k'][t] == '79.3'] 


StarU •• 从扣 -^7 七 ⑽ C 二 G ^ Tu,rh ^ difitiohdir/s keys i h io a list 

cr^ybf l» m ro>w_da*tarZOk’].keYs0: 

i-f row daiatZOk'JUach {3 =■=■ K l°i V' 

Thcvc s a tn^e.app ⑶ d(eadh 一七） 、 

dc-fihi-tc patt CV-h p 

c^cv-gihg hcvc. © i \/^\{^ rteraticw, *to see »士 *0^ 

co\^ ^cadmj (tV^c value part 
d^-tio^av-y) c^als “"7V and vf it does’ 
append *t^c *tiw>c *to *bV^c list 
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dealing with complexity 


fret input from your user 


Now that you have your data within a Python data structure, it’s time to ask 
your user what it is they are looking for. 

Specifically, you need to know three things: the distance run, the time recorded, 
and the distance a prediction is required for. 


When you get to move your app onto Android, you can use a nice graphical 
dialog to ask your user for input, but for now, let’s quickly create a text- 
based user interface, which will allow you to develop and test the rest of the 
functionality required from your application. When you’re done, you’ll create 
the Android app. 


Use iwputO for input 

Python has the input () BIF that can help here, which is used to display 
a prompt on screen, and then accept keyboard input, returning what was 
entered as a string to your code. 


/•An IDLE Session 




Using the input () BIF is best demonstrated with some examples: 

»> res = input('What is your favorite programming language : ') 

What is your favorite programming language : Python 

>» res nc data *»s ass.jncd Vs" 

'Python' ^ - “AaSTR 叫 


Provide ihc pirompt io display 
"to youv- usev. 


The input () BIF returns a string, which has been stripped of any trailing newline character, which would 
typically be included at the end of any input string. It is important to note that any input is returned as a string, 
regardless of what type of data you think you might be entering: 


The sieved data is assigned io 

a even -though you mighi io 

■breai rt like ii’s a ^umbev-. 

Covert iyyc you 

BEFORe usm 3 data. 



»> age = input (' What is your age : ') 
What is your age : 21 
»> age 
,21, 

»> int (age) 

21 


[E>drbov"’ s 七 c: VcaV^... 

(j[y-c3w\ oy\, Paul. 
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input error 


========================== RESTART ========= 

distance attempted ： 20k 
recorded time ： 59:59 

distance you want a prediction for ： Marathon 


>>> = 
»> 
Enter 
Enter 
Enter 
»> 


>>> 

»> row dat_ajdistance_run] [ recorded—time] 
TraceJbacK ~~ fmostrecent ~~ ua 丄丄 — xast ；： ' 

File 1, <pyshell#76> 1 ' f line 1, in <module> 
row_data[distance_run][recorded_time] 
KeyErrori p 59:59 



A W ^cyE\r\ro\r W hds 

be ⑶ raised...bu 七 why? 


ftcttmg input raises an issue... 

It’s not hard to use input () to get the, um, er. • .input you need. Here’s your 
code from earlier with three calls to input () added to interact with your 


user. 




marathon.py - /Users/barryp/HeadFirstPython/chapterll/marathon.py 


row data 


{> 


with open( 1 PaceData,csv 1 ) as paces! 

column 一 headings - paces.readline().strip().split( 
column 二 headings.pop(0) 

for each line in paces : 

row = each_line,strip().split( r , 1 ) 
rowlabel = row.pop(0) 
inner_dict = {} 

for i in range ( len( column 一 headings))i 

inner_dict [ rowji]] = column_headings [ i] 
row data[row label] = inner diet 


y\o*b^'m5 *to ^ |S, as 

usc^r-m-bcvattio^ 

doc; 七 y 七 ^ cas.cv 七 
七 Wn 


F ) 


distance 一 run = input ( r Enter the distance attempted : 
recorded_time = input ( 1 Enter the recorded times 1 ) 
predicted distance = input ( 'Enter the distance you want a prediction for : 1 ) 




Ln: 20 


Co [: 0 


A 


When your program runs, your user enters some data, and look what happens: 


矜 n ^ 


Python Shelf 


0 

▲ 


Ln: 20S Col: 4 ^ 


eee 
h h h 
111 
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dealing with complexity 


If if s wot iw the dictionary, it caw't be found. 


The data in the row_data dictionary originally comes from the spreadsheet 
and is read into your program from the CSV file. 


If the data value entered into the re corded—time variable is in the dictionary ， 
things are going to be fine, because there’s a match. However, if the data entered 
into the re corded—time variable doesn’t match anything in the dictionary, 
you’ll get a KeyError. 

But how is this “problem” handled during training? 





time a ZOk 

-falls two 

values oh the yau sheet. 


IMc 

26:54 

Z7 : 邛 

Z0：DiQ J \ 

za：45 

Z，:14 | 

15K 

4l：^1 

取 jr 



4& ： 2^ 

1 


45 ： 4E 广 

y 

^r ： 5i \ 

批 5« 

皿 



59 :叫 Li 

1 ： &Il ： i3 J 

iim\45 

13.1ml 


1 ： D1：W 

iTBZiSl 

iTiFSTaS 

iMM 

观 

1:413 


H:14 ： 5^ 

1:15:40 

1:16:24 

Mfc 



1:31 ： 0B 


1 ： i5.：17 

Marathon 

Z ： DS：34 

Tm\2A 


2 ： 14 ： IS 

S ： 1T：16 
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close enough 


Search for the closest match 


All you need to do is search the row of data for the closest match, right? 



And guess what? The Head First Code Review Team think they have some 

functions that might help here. 

♦ - - — - 

There's nothing better 
than sharing our code 
with our fellow Python 
programmers. Check out 
our、、f ind—it” module. 


J\s\s code *»s *m a ailed 
and you tan 

doY/ylodd a W 恤 

book's su^o^rb ▲ 心 . 



V 







find_it.py - /Users/barryp/HeadFirstPython/chapterl 1 /find_it.py 


def find closest (lookfor, targetdata )! 々 


def whats the difference (first, second) 
l 7 一 if first == second ： 

\y return ( 0 ) 

elif first > secondi 

return( first - second) 
elsei 

return (second - first) 


卜 "h example a hC stcd 

+uhrt'.oh, whi 匕 h is allowed 

| h P 炉 0 h . two values, 

+ u ^^tioh v-ctuv-hs -the 
between them. 


maxdiff = 9999999 
for eachthing in target data: 

diff = whatsthedifference(eachthing, look for) 
if diff == 07 ~ ~ 

found_it = each_thing 
break - 

elif diff < maxdiff : 

max diff = diff w av ⑽七 “ 七 ^ most 


return (found it) 


found_it = each 一 thing 


scav-^ todt cvev 

bu 七 i 七 ^io^Vs. 


Ln: 22 


Col: 0 


A 


TV w <fmOloW 

-fuv\C.*bioy\ docs B snrwpU 
Imcav scar^, 代七 ” 
i\,t value *m 七一祕 
most closely wattes 

七 V>e “look 一 av^uwe^t 
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dealing with complexity 


r ^ / An IDLE Session 


Let’s test the f ind—it • py module to try and determine if it meets the requirements of your application. Load 
the module into IDLE and then press F5 or choose Run Module from the Run menu: 

»> f ind—closest (3.3, [1.5, 2.5, 4.5, 5.2, 6]) 

2.5 

»> find_closest (3 , [1, 5, 6]) 

1 

»> find_closest (3 , [1, 3, 4 , 6]) 

3 



f ， a value -to look 

卜 the W -fihd^los«t w 

-ruh^iioh seems -fco be 
doihj the tvidc 


»> find_closest (3.6, [1.5, 2.5, 4.5, 5.2, 6]) 

4.5 

»> find_closest (3 , [1, 4 r 6]) 

4 

»> find—closest(2.6, [1.5, 2.5, 4.5, 5.2, 6]) 

2.5 


Let’s try it with some of data that more closely resembles your CSV data: 

»> find 一 closest ('59:59、[' 56: 29 \ ' 57 : 45 \ '59:03' , '1:00:23 、 '1:01:45']) 

Traceback (most recent call last) : 

File "<pyshell#23 >", line 1 , in <module> 

find 一 closest ('59:59 、 ['56:29 、 '57:45' , '59:03 、 '1:00:23 \ '1:01:45']) 

File M /Users/barryp/HeadFirstPython/chapterll/find_it.py M , line 15, in find_closest 
if diff == 0: 

File M /Users/barryp/HeadFirstPython/chapterll/find_it.py M , line 11, in whats_the_difference 
^^ypeError : unsupported operand type (s) for - : ' str' and ' str' cl SowC"tWm^S SC^ously 







What do you think has gone wrong here? Why 
does the f ind closest () function crash when 
asked to work with data from your CSV file? 
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time trials 


The trouble is with time 

The data in your CSV file is a representation of timing values. Rather than 
actual numbers, the values in the CSV are strings. This is great for you, 
because joz/ understand what the representation means. Python, on the other 
hand, sees the data only as strings. 

When you send your data to the find_closest () function, Python 
attempts to treat your strings as numbers and chaos ensues. What might work 
would be to convert the time-strings into numbers. But how? 



Yeah, of course! 

DidtVt we write the 
'tm2secs2tm /, module to 
handle this sort of thing? 


When I have to work with 
times, I always convert my 
time strings to seconds 
first... 
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dealing with complexity 


The timc-to-sccowds-to-timc module 


The Head First Code Review Team’s generosity knows no bounds. Sure enough, their 

rather strangely name tm2secs2tm. py module looks like it might help. d ^opy o( "this Codt *(Vo» 

this book's support websiic. 


tteves i\\c 的 、" 

module. 


/ 


H O O 


Em2secs2tm,py - /Users/barryp/HeadFirstiPython/chapterll/tm2secs2tm.py 


import time 

def format_time( time_string)s 
tlen -^len (time_string) 
if tlen < 3 1 

original_format = ' % S f 
elif tlen < St 

original_format = r %M:%S 1 
else : 


TW,S WUW 如七 all tws a 代 Watted rn 

观 : TK»s Keifs keep 七 Wy 一 pie ▲— 

dohVc\rs*»or\s *to sc^ohds. 


original_f ormat = 1 %H:%M:%S f 

time_string = time.strftime( 1 %H ： %M:%S f f time,strptime(time_string, original_format)) 
return (time string) 

咖 eh do 賊七 t to “alue m sedohds. 



def time2secs (time_string) : 

time_string 二 format_time(time_string) 

(hours, mins # secs} = time_string.split( ' i 1 ) 

seconds = int (secs) + ( int^mins ”60) + j intj hours)*60*60) 

■ — ___. Co^vcv-t a value m seconds *to a stvmj - 

def secs2time( seconds)i ^ " 

return (time.strftime( 1 %H ： %M ： %S ' , time.gmtime(seconds))) 


Ln: 24 


Col: 0 



Now that you have the tm2secs2tm.py and find—it .py modules, let’s create a function 
that uses the facilities provided by these modules to solve your searching problem. Your new 
function, called f ind_nearest_time (), takes two arguments: the time to look for and a 
list of times to search. The function returns the closest time found as a string: 


TV\c code you 
y\ccd bcc 
s*tav-*tcd -fov- 
you. 


from 


find_it import find—closest 
tm2secs2tm import time2secs 


def find nearest time(look for. 


, secs2time 


target—data): 


Whlikc ih the previous 
匕 hdptcir, it is possible 

"to do what you heed - ^ 

"to do heire ih ohly 
*Pou\r lihes o-f Code. 
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time to string 



Iwfov 七七 ^ 

七 todc- 


Now that you have the tm2secs2tm.py and find—it .py modules, you were to create a 
function that uses the facilities provided by these modules to solve your searching problem. Your 
new function, called f ind_nearest—time () ， takes two arguments: the time to look for and 
a list of times to search. The function returns the closest time found as a string: 

from find—it import find—closest 
from tm2secs2tm import time2secs, secs2time 


The -Puh^tioh iakcs two 
a time sVmg 
d lis-t o-f stvihCks 

def find 一 nearest_time(look—for, target—data): j 

Cohvcvl the time stvma — — n C ^ ~ 

you ⑽ looking ihio its 七二 h^tZstCsLlookJcorJ 

—M ： * _ 一 ， ^ ，WC 

Call 吖 mdLtlosdO' res =• -f*md_dloscs*t(y/ha*t, where) p ± 

su??lv'm5 to^veyrted data.. = . Kctuv-h the closest io the dalliha 

\re*tu\rh(scdsZ*time^v-cs)) 3 士 七饮 dohVc\rtmg it -to a time 

. stvihg. 


H 




i An IDLE Session 


Let’s try out your code at the IDLE shell to see if your time "problems” have been resolved: 


s o-T youv 
pa 以 daia. Lei's 
woirk with daia 4。啪 


IQH 

26:54 

27: ⑽ 

23：WB 

Z&: 财 

Z9：24 


41: 艺 1 

^ZJ17 

d4 

W：23 \ 

45® 


44 M 

奶 :4E 

45:44 

) 

邱: 》 

L 肌、 j -， 


57 45 

59: 扣 


1 ； EH：45 

IJ.iml 



1:021^1 


1 ： & 5 ： Z3 

25K 

111 1 ： 4I3 


1 ： U：OT 

1 ： lS ： 4iD 

i;ie:z4 

3€k 

1 




1 ： i5：17 

Marathon 

Z ： DS：M 

2 ： DB：24 


2：14： 11 ^ 

Z ：1 T ：16 








»> find_nearest_time('59:59 ^, ['56:29 ', '57:45 ', '59:03 ', '1:00:23 ', '1:01:45']) 
, 01:00:23 , 

»> find_nearest_time('1:01:01 ', ['56:29 ', '57:45 ', '59:03 ', '1:00:23 
'01:00:23' 


1:01:45']) 


»> find_nearest_time('1:02:01 ', ['56:29 ', '57:45 ', '59:03 ', '1:00:23 ', '1:01:45']) 
'01:01:45' 

»> find_nearest_time ('57:06' , ['56:29 、 '57:45' , '59:03' , '1:00:23' , '1:01:45']) 
'00:56:29' 


TW.S 

appeals 

*bo fee 

v/ov-k'm^ 

•fmc. 
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Tesr DriVq 



With all this code available to you, it's an easy exercise to put it all together in your program and 
produce a complete solution to the Marathon Club’s prediction problem. Let’s take it for a test run. 

marathon,py-/Users/barryp/HeadFirstPython/chapteril/marathon.py 





from find_it import find_closest 
from tm2secs2tm import time2secs, secs2time 

def find nearest time (lookfor, targetdata)i 
what—= time2secs(look for) 

where - [time2secs(t) — for t in target data] 
res = findclosest(what, where) 
return (secs2time(res)) 

rowdata = {} 

with open ( F PaceData.csv F ) as pacesi 

column_headings = paces■readline().strip().split(' 
column 二 headings.pop(0) 

for each line in paces : 

row = each 一 line.strip().split( ' , ' ) 
row label = row.pop(0 j 
inner_dict - } 

for i — in range ( len (column_headings))i 

inner_dict[row [ i]] = Bolrnnn—headings [ i] 
row_data[row_label] = inner_dict 


This Code is used M as is w . 


distance run = input ( f Enter the distance attemptedi 1 J 
recorded~time - input ( 'Enter the recorded timer ' ) 
predicted_distance = input ( ' Enter the distance you want a 


pmd 七 ^ 七加 c 

d&ts. 

七 he 

dolunrm hedd’m} 

， ediction fori 



closest_time = f ind__nearest_time ( r 0 corded_time f row_data[ distance 一 run]) 
clos es t~c olumn_heading = row_data [ distance_run] [ clos es ] 

prediction = [k for k in rowdata [ predicted distance].keys ( ) 

if rowdata [ predicteddistance] [ k] == closest_column_heading] 

print ( ' The predicated time running f + predicted_distance + F isi f + prediction [ 0] + 



•Seav * 乙 h -Po\r 
a p 代 dieted 

ai 

"the dcsi\rcd 
disian^e av\d 
display it 


Oh 


Ln: 37 


Col: 0 


A 


^ ^ ^ Python Sh&U 


»> — - 一 — 一 ———~__ RESTART -- 

Enter the distance attempted! 20k -- Tv-y 7 OU p ? ,r0 5 ,ra，r r ^ ^ 

Enter the recorded times 59:59 

Enter the distance you want a prediction for : Marathon 

Traceback (most recent call last)i 

File 11 /Users/barryp/HeadFirstPython/chapterll/marathon,py 1 ", line 31, in <modu!e> 
closest CLTrt=-<^heading - row data 丨 distance run] [ closest time ] 

| ^ rror: ^ 11 -— “饮 YeyE^o/... 

(PS 

▲ 

▼ 


Ln: 13 

Col: 4 



After all that, you’re getting the same error as before. Bummer. 
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more time trials 


The trouble is still with time. 


Or, to be more precise, with how the tm2secs2tm. py module formats 
time strings. Take another look at the results from the previous IDLE Session. 
Do you notice anything strange about the results returned by the call to the 
find nearest time () function? 


AH 

七 iwCS 
use 




»> find_nearest_time('59:59 ^, ['56:29 ' r '57:45 ', '59:03 ', '1:00:23 ' r '1:01:45']) 
(^01^00: 23* 

»> find_nearest_time('1:01:01 ', ['56:29 ', '57:45 ', '59:03 ', '1:00:23 ', '1:01:45']) 
( ^03^0:23' 

»> find_nearest_time('1:02:01 ', ['56:29 ', '57:45 ', '59:03 ', '1:00:23 ', '1:01:45']) 
p0l)01:45 , 

»> find nearest time('57:06 ', ['56:29', '57:45 ', '59:03 ', '1:00:23 ', '1:01:45']) 


( 5 ) 


56:29 


When your code takes one of these returned values and tries to index into 
your dictionary, there’s no match found, because your dictionary’s keys do not 
confirm to the HH : MM : SS format. The solution to this problem is to ensure 
that every time you use a time-string in your code, make sure it’s in HH : MM : SS 
format: 

A 凸 '、 marathon.py - /Users/barryp/HeadFirstPython/chapterll/marathon.py 


from find_it import find—closest 
from tm2secs2tm import tlme2secs, secs2time, 


def find nearest time (lookfor, targetdata) : 
what = time2secs(lookfor) 
where = [time2secs(t) — for t in targetdata] 
res = find_closest(what, where) 
return (secs2time(res)) 

row_data = {> 

with open( 'PaceData.csv' ) as paces: 

columnheadings = paces.readline().strip().split( 
column~headings.pop(0) 

for each_line in paces: 

row = each_line.strip().split( ' , ' ) 
row label = row.pop(0) 
inner_dict = {} 

for i~ in range^J«^srtt ； oiumn_fteaa^s^^M 

inner_dic^[f ormat _ t i in 6( row [ij/ ] 

row_data[ row Vtt— ’ -- '^rr 



distance_run = input ( ' Enter the distance attempted 
recorded=time = input ( ' Enter the recorded time 
predicted distance = input ( 'Enter th^ Hi stance 


closesttime = find_nearest_time 
closest_column_heading = row_dat 


^formattime (re 



七 U 一七“ A 

Wsc 仏彳 h> Chsuv^c the iin.es 

严 d ihtcirhally by youv^ dodc 

bailed ih w Htt：yviM：ss w ^at 

4s[i] 


prediction for: 


ecordedtime), row_data[distancerun]) 
[closest_time] 


prediction = [k for k in rowdata[predicteddistance].keys() 

if rowdata[predicteddistance][k] == closestcolumnheading] 

print ( ' The predicited time running ' + predicteddistance + ' is: ' + prediction!0] 
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Tesr DriVq 


Let’s try your code one more time. Hopefully, now that all of the time strings within the system 
conform to HH : MM: SS format, your code will behave itself. 


Python Shell 


Python 3.1.2 (r312i79360M f Mar 24 2010, 01:33:13) 

[GCC 4.0.1 (Apple Inc. build 5493)] on darwin 

Type 11 copyright 1 ', 11 credits " or 11 license ( } 11 for more information. 

»> —— 一 ——■ —— 一 一 — 一 一一 — 一一 — RESTART ———————————— —— ———— ———— 一 一 ~ 

Enter the distance attempted: 20k 丁 IS the pv-cvious ics-i, 

Enter the recorded time: 59 i59 f with ^ i} 

Enter the distance you want a prediction fori Marathon / c / 乂饮， 

Traceback (most recent call last)i (U- 

File /Users /barryp/HeadFirstPython/chapter 11 /marathon. py 11 , line 31, in <module> 
closest column heading = row data[distance run][closest time 1 

KeyError t 01:00:23 p 

»> -- RESTART -- 

Enter the distance attempted; 20k ^ 一 H TW»s twc av-ouy\d, Y ou，r 

Enter the recorded timei 59 1 59 0^ ., .pi h s 

Enter the distance you want a prediction fori Marathon VtscHr ^ 

The predicited time running Marathon is i 02 i 14 i 15, 

»> - - - RESTART —————— - 

>» 

Enter the distance attemptedi 5mi Aho-l-k^ir 4-^,1 r. .. 

Enter the recorded timet 23:45 丨. t coh+Mrms -that thihgs avc 

Enter the distance you want a prediction for : lOmi 、 woirkihg well. 

The predicited time running lOmi is; 00 1 50 : 02 , 

»> 二一一 一 — ——— — RESTART —— — ■--——— 一 

»> 

Enter the distance attemptedi 10k 

Enter the recorded timet 32i15 

Enter the distance you want a prediction for; 25k k , C- 州 akes suve- 

The predicited time running 25k is: 01 ： 2 5 1 4 9 * one -rm 

»> 


Ln: 31 Col: 4 

* - 1 - L 



This is working well. You’ve solved your application’s central problem: your 
program reads in the spreadsheet data from the CSV file, turns it into a 
dictionary of dictionaries, and lets you interact with your user to acquire 
the recorded time at a particular distance before predicting a time for 
another distance. 

Not counting the code provided by the Head First Code Review Team, 
you’ve written fewer than 40 lines of code to solve this problem. That’s 
quite an achievement. All that’s left to do is to port your program to the club’s 
Android’s phones. 


And porting to Android won’t take too long, will it? 
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android interface 


Port to Awdroid 


Your code is working great. Now it’s time to port your text-based Python 
program to Android. Most of your code doesn’t need to change, only the 
parts that interact with your user. 


Obviously, you’ll want to make things as easy to use as possible for users of 
your latest Android app, providing an interface not unlike this one. 



10k 


ISk 


20k 


20k 


25k 


I. fey 


\ ru 扒 ... 


Select a 
distaste *to 
pv-cdit*b *to-• 


2 - the 

time.. 


公圆 e 9:29 




Pick a distance to predict 




Marathon 


Select 


This is a 
dialog box. 


These avc both 
dialog boxes. 


TWis is a ,, 
Vial 。 命七卜 ? u 七 ” 

dialog bo%. 


午 . A-ftc\r -the 
lookup, display 

the p 代 dieted 

time. 
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dealing with complexity 


Your Android app is a bunch of dialogs 


Your Android app interacts with your users through a series of dialogs. Other 
than the single dialog that requests data from your user, the other three share 
certain similarities. You can take advantage of these shared features by 
creating a utility function which abstracts the dialog creation details: 



25k 


30k 


display the dialos a^d 

代七心 ihe stktitd iicr,. 


TV dialog 
七 rtlc 


The of 

values *to display. 


The dialog 
method name. 


The text -fo^* 

the bu-fc-fcohs, 

with defaults. 


def do dialog(title , data, func , ok='Select ', notok='Quit') : 


app.dialoqCreateAlert(title) 


app.dialogSetPositiveButtonText(ok) 


app.dialogSetNegativeButtonText(notok) 


app.dialogShow() 

return(app.dialogGetResponse().result) 


func(data) 


if notok : 


Sharpen your pencil 


Assume the existence of a list called distances, which contains 
the row distance labels (2m/, 5k, 5mi, and so on). In the space below, 
provide the two calls to the do_dialog () function needed to create 

the two dialogSetSingleChoiceltems shown on the left of 
the previous page. 
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adding dialog 

^ Sharpen your pencil 

Solution 



You were to assume the existence of a list called distances, which 
contains the row distance labels. In the space below, you were to 
provide the two calls to the do_dialog () function needed to create 

the two dialogSetSingleChoiceltems. 


do_d_alog(”Pi6k a dis-tahdcs, 


provide -the list o( 
items -to display. 


pv-ov'idc *bV^c , 

a\alo 5 七 vblc. . . .. 

do dialo<\( w Pidk a dis-ta^c bo predict' dis-ta^dcs, - pvovidc *t^c 

V\ih >： do it all . " ) . . ] . r . iw ^ d，al °5 

-fo^* -the - / app dialogSc-tSmglcChoidcl-tcims) 七 o use. 

otheir dialog. 


ttcv-c^ 
ay\o*bV^cv- 



do_dialog('The predicited time running ' + predicted 一 distance + 

'is: prediction, app.dialogSetlterns, n OK n , None) 


Th,s last o, c s a HUle Wki c , ; b^ U s C 

you have io build up the dialog title 

, 0rn so ^ v ^bles (i^i you ^|| hCCC 
have Scaled 


y\ttd -to 


Use a diWcvcyrb d^alo^ 
crea 七叫 method 
七 iwC. 



Ovcv-v-idc the 

dc-p3ul*t values -Pov* 
"the di^(o 0 s bu*t"toi 


^ct your Android app code ready 

To use your dialog creating code, import the necessary libraries, define 
some constants, create an Android object, and reuse some code from 
earlier in this book: 


import time re¬ 
import android 

distances = [ '2mi 


、 po Y° uy, 士 . 


5k 1 , '5mi', '10k', '15k', '10mi', '20k 

'13.lmi ', '25k', '30k', 'Marathon'] 


hello—msg = "Welcome to the Marathon Club's App’ 
quit msg = "Quitting the Marathon Club * s App." 


Create a T»st 

vo>/ labels. 


app = android.Android() 


Cy-caic ah A^dvoid 
app object. 


def status—update(msg, how—long=2): 

app • makeToast (msg) ^ 丁仏 \ s W as-'is 


)) 


time.sleep(how_long) 



心。州 cav-l'»cv- m *tW»s book. 


L -^ i 


^C-fihC two 

*Pv-ichdly 
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puzzjc 

Your job is to take the code from the pool and place 
it into the blank lines in your Android app code. 

You can assume that the row_data dictionary 
exists and has been populated. The variables 
shown at the bottom of the last page have also 
been created, and the status—update () 
and do_dialog () functions are available 
to you. Your goal is to arrange the code so that it 
implements the Ul interactions you need. 

status—update(hello—msg) 

resp = do_dialog("Pick a distance ", distances, ) 



distance run = 

distance run = distances[distance run] 

=app . dialogGetlnput (’'Enter a 


"Use 


M + distance run + 
HH : MM : SS format : M ) 


M time : 
.result 


The dialog^c-t/hputO wthod 
displays -the ihpu-t dialog box. 


closest_time = find_nearest_time(format_time( ), row—data[distance run]) 

closest—column heading = row—data[distance run][closest—time] 

resp = do_dialog("Pick a distance to predict ", distances , ) 


predicted—distance = 

predicted—distance = distances[predicted—distance] 
prediction = [k for k in row—data[predicted—distance]•keys() 

if row—data[predicted—distance][k] == closest—column heading] 
do 一 dialog('The predicted time running ' + predicted—distance + ' is :', 

prediction, app•dialogSetltems, M 0K M , None) 

status—update(quit_msg) 
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out of the pool 



Your job was to take the code from the pool and 
place it into the blank lines in your Android app 
code.You were to assume that the row_data 
dictionary exists and has been populated. The 
variables you need also have been created, and 
the status—update () and do_dialog() 
functions were available to you. Your goal was 
to arrange the code so that it implements the Ul 
interactions you need. 


Ask yowr uwfco pi 匕 k 占 


status—update(hello 一 msg) 



resp = do_dialog("Pick a distance ", distances, app•dialogSetSingleChoiceltems) 
if resp['which'] in ('positive'): 


distance run : 
distance run : 
recorded time 


app.dialogGetSelectedltems()•result[0 
distances[distance—run] 

: app•dialogGetlnput("Enter a M + distance run 

"Use HH:MM:SS format : 


distaste label 


Ask youv usev 伙七饮 ihe 

yce.o\rdcd 


+ M time : 
).result 



Wovk ou*b 

toWw\Y\ 

V\cad'm5 *to 

use- 

Look up 
pv~cdul'tioh. "~ 


closest_time = find_nearest_time(format_time(recorded_time ), row—data[distance run]) 
closest_column heading = row—data[distance run][closest_time] 

resp = do_dialog( M Pick a distance to predict ", distances, app•dialogSetSingleChoiceltems) 
if resp['which'] in ('positive'): 

predicted—distance = app.dialogGetSelectedltems()•result[0] 
predicted_distance = distances[predicted—distance] 
prediction = [k for k in row data[predicted distance].keys() 

, if row—data[predicted—distance][k] == closest_column heading] 


Ask youir useir -fco pi^k a 

disWe ihc list o( 
labels -to -to. 


do—dialog('The predicted time running ' + predicted—distance + ' 

prediction, app.dialogSetltems, M 0K M , None) 

status update(quit msg) 


is 


pis^lay 广 edited Wc a 七如 

selected a.sta^c usev. 
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dealing with complexity 


Put your app together... 

You now have all the code you need to create your app: 


marathonapp.py - /Users/barryp/HeadFirstPython/dhapterll/marathoinapp.py 

—ort time - Do VOUV- 1 叶。士 . 

import android 1 

from find it import find cloBeat 

from tm2 secB2 tm import time2 secB f b€-cb2 tim-e r format time 

def find nearest time ( look for r target data} : w p. , i/y> 

what = t ime 2 B-ec b ( look for \ > |w£.ludic VOUV" JhC^V'CS'tw 

where = [ t ime 2eecs ( t ) for t in target data ]、 p 

ree = find cl-DBGBt ( what r where } *VuK\C-*t*Oir\. 

re tu rn ( Bee b2 time ( res].) 

distances = [ ! 2mi 1 . ! 5k ! . ! 5mi ! . ! 10k 1 . 1 15k ' . ' IQmi \ ! 2Qk 1 . ^ — Dc^la\fC VOUV" 

1 13.Imi 1 r 1 2 5k 1 f 1 3 Ok ' r 'Marathon 1 ) 1 

hello nisg 曰 “■Welcome to the Marathon Club ' e App 

nieg ^ "■Quitting the Marathon Club ' e App . 1 kl/\-rr m 

— 叫， ^ ^cardIs 1 ^ i ^ ilc ° h ^ 

with open ( ' / adcard/ &14 a / scripte/Pa-ceData . cev 1 ) elb paceB- : 
column headings - paces . readline ㈠ ■. Bt.rip i| }, split < 1 } 

row = each^line . atrip (). eplit (' r ' ) - - ' Q£\J 

row label - row.pop (0} n 

inn-er diet = { } 

fox i in range ( len (column headingB )): 

inner diet [ format time ( row[ i ) ) ) — column. headingB [ i J 
row data [ row label ) = inner diet 

app = androi " Android0 ^ — ^ you ， A ， d,oid a P p oW.cti a,d 

dGf : pp^Seio^tSl^i you, hclpc, Wtio,s J 

time . sleep (how long } ^ ^ 

def do dialog ( title , data, func f ok- Select ' t notok= ' Quit ' ) : 
app . dialogCraateAlert ( title ) 
func (-data ) 

app ■d ialo g Se tPo &itiveButtonText < ok ) 
if no tok : 

app .dialog Set Me gat iveEot touTejn t ( : no tok ) 

app.dialogShow( } ,丄 Awdl PVOtCSS 

return (app . ■dlialogSetEeBpcinBe (}» result ) ^iSPidV VOUV" IA| XO ^jOyAv wsc l 

atatuB update ( .hello msg } ^ "t-V\C VCSul*b>^^ \ 

r-e &p = do dialog ( "Pick a dis t ance " f di&ta nee b , app. d i a lo g Sg t S i n g leCho ice I teuiB J 
if reap [ 1 which 1 ] in ( 1 positive 1 } : 

■d i b tance run = app . di alo gGet Se lec ted I terns () . reeult [ Q ] J 

distanc-e run = ^ie-tancieB- [ die-tanc-e run | j / 

r-ecorde-di time s app . di a logSe t Inpu t ( Enter a ' + distance run ■+ " 1 1 me : " f {/ _ 

"U B-e HH i M>4 : SS format; J. reBiilfe 

cloBeet tim-e = find near^B-t time ( format time ij recorded time ) f row data [diBfcanc 丑 run ) ) 
cloBes-t -coluimn heading ^ row data [-distance run ) [ closeet time ] 

reap s do dialog ( "Pick a di&tance to predict '' , dlietancciB f app ■ dialogSetSingleChoiceltemB ) 
if resp [ 1 which ' ) in ( 1 poBitive 1 )■ : 

predicted distance app - dialogCetSelecte"dItemB" result [ d J 

predicted distance - d i & t a nee b [ p r e-dl ic tedi diBtanc-e | 
prediction ^ [k for k in row data [ predicted distance ]. keys () 

if row data [.p r-ediclued die-tance ] [ k ) =- clo Bfi b t column heading ) 
do dialog ( ' The pxedicited time runriiiiig ' •+ predicted distance + ' 1b s ' r 

prediction t app - dialogSetltemB r "OK" P Mcrne ) 

BtatuB update { quit meg ) 


Ln: 67 Col: 0 

.义 
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Tesr DriVq 


It’s time to test your Android app on the Android Emulator before loading a working application 
onto a "real" phone. Start your Android emulator and begin by transferring your code and the 
files it needs onto the emulator’s SDCARD. Use the adb command in the tools folder to copy 

marathonapp . py, f ind_it. py, tm2sec2tm. py and PaceData . csv to the emulator, and 
then take your app for a spin. 

I File Edit Window Help CopyToEmulator 


Co ^ 

-f iles *to *bV^c 
cwula-tov- Wrth 


$ tools/adb push marathonapp.py /mnt/sdcard/sl4a/scripts 
43 KB/s (2525 bytes in 0.056s) 

$ tools/adb push find_it.py /mnt/sdcard/sl4a/scripts 
7 KB/s (555 bytes in 0.069s) 

$ tools/adb push tm2secs2tm.py /mnt/sdcard/sl4a/scripts 
12 KB/s (628 bytes in 0.050s) 

$ tools/adb push PaceData.csv /mnt/sdcard/sl4a/scripts 
59 KB/s (4250 bytes in 0.069s) 




/W 七 V\C\rC I 七汶 ” 

W y ou 

•to 七 cs 七 it 


« r) 


5554:droid2.2 



Scripts 

bluetooth_chat.py 
$ coachapp-KEEPER.py 
coachapp.py 
•gifind_it.py 

get2inputsapp.py 
令 hellO-World.py 


Bl 圆】 2:39 pm 

I 


@ 0 @ @ 


O) 




© 




igi marathonapp.py 

1 

2 

3 

4 

5 圓 

6 

B & 

8 

9 |o | 

电 i notify_weather.py 

Q 

w 

E 

R 

T 

y| 

u 

I 

ww 

igi say_chat.py 

A 

s 

D 

F 

G 

H 

J 

K| 

i 7 圖 

0 sayjime.py 

□ 

z 

X 

C 

V 

B 

N 

M 



ALT 

SYM 

@ 


k. 



ET_kl 


Go on. You know you want to: tap that app! 
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dealing with complexity 


Your app's a wrap! 

All that’s left to do is transfer your working Android app to the Marathon 
Club’s phones.. .and that’s easy when you use AndFTP. When you show off 
your latest work, the club’s members can’t believe their eyes. 




And there's wo stopping you! 

You’ve put your Python skills and techniques to great use here. 

Whether you’re building an app for the smallest handheld device or the 
biggest web server, your Python skills help you get the job done. 


Congratulations! 
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Your Pythow Toolbox 

You’ve got Chapter 11 under your 
belt and you’ve demonstrated a 
mastery of your Python toolbox. 
Congratulations and well done! 


•, s w 妊 at .eludes a 4 
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^ Usi 6 。十 — 
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BULLET POINTS 


The input () BIF lets you prompt and 
receive input from your users. 

■ If you find yourself using Python 2 and in 
need of the input () function, use the 
raw—input () function instead. 

■ Build complex data structures by 
combining Python’s built-in lists, sets, 
and dictionaries. 


■ 


The time module, which is part of 
the standard library, has a number of 
functions that make converting between 
time formats possible. 
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dealing with complexity 


If s time to go... 



This is just the beginning 

We’re sad to see you leave, but there’s nothing like taking what you’ve learned and putting it to use. You're 
just beginning your Python journey and you’re in the driver’s seat. We’re dying to hear how things go, so drop us a 
line at the Head First Labs website, www.headfirstlabs.com, and let us know how Python is paying off for YOU! 
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You’ve come a long way. 

But learning about Python is an activity that never stops. The more Python you code, 
the more you’ll need to learn new ways to do certain things. You’ll need to master new 
tools and new techniques, too. There’s just not enough room in this book to show you 
everything you might possibly need to know about Python. So, here’s our list of the top ten 
things we didn’t cover that you might want to learn more about next. 
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# 1: Using a "professional" 1PE 

Throughout this book, you’ve used Python’s IDLE, which is great to use 
when first learning about Python and, although it’s a little quirky, can handle 
most programming tasks. It even comes with a built-in debugger (check 
out the Debug menu), which is surprisingly well equipped. Chances are, 
however, sooner or later, you’ll probably need a more full-featured integrated 
development environment. 

One such tool worth looking into is the WingWare Python IDE. This 
professional-level development tool is specifically geared toward the Python 
programmer, is written by and maintained by Python programmers, and is 
itself written in Python. WingWare Python IDE comes in various licencing 
flavor: it’s free if you’re a student or working on an open source project, but 



More general tools also exist. If you are running Linux, the KDevelop IDE 
integrates well with Python. 

And, of course,there are all those programmer editors which are often all 
you’ll ever need. Many Mac OS X programmers swear by the TextMate 
programmer’s editor. There’s more than a few Python programmers using 
emacs and vi (or its more common variant, vim). Your author is a huge fan 
of vim, but also spends large portions of his day using IDLE and the Python 
shell. 
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Coping with scoping 

Consider the following short program: 

global variable called 


' scope,py - barryp/HeadFirstPython/Top Ten Things/scope.py 


name = "Head First Python" 

def what_happens_here( } i 〆 A -fuh^tioh whi^h 

." , ^ aitempts io 

print ( name) ^ - r. . , , 

name = name + 11 is a great book! 1 " ^ 5hd to 

print ( name) pr the global vavidble 

.p . 1- 乙 ailed W h3mc w . 

what_happens_here() 冬 〆 Call inc \\AV\tt\or\- 
print ( name) 

1 心 



L 

Ln: 12 

Col: 0 

j 


， what is sc-t -to 

the kuho^ vuhs. 


If you try to run this program, Python complains with this error message: 
UnboundLocalError: local variable c name’ referenced before assignment.. .whatever that 
means! 

When it comes to scope, Python is quite happy to let you access and read 
the value of a global variable within a function, but you cannot change 
it. When Python sees the assignment, it looks for a local variable called 
name, doesn’t find it, and throws a hissy fit and an UnboundLocalError 
exception. To access and change a global variable, you must explicitly declare 
that’s your intention, as follows: 


scope.py - /Users/barryp/HeadFirstPython/Top Ten Things/scope.py 


name - "'Head First Python ,1 

def what^happens here ( )i 

print ( name) 
global name 

name = name + 1,1 is a great book! 11 
print ( name) 

what—happens_here() 
print ( name) 

1 


Ln: 13 Col: 0 

A 




(ihd this 

，•心 ugly. Oihcirs thihk \i l s 
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Testing 


Writing code is one thing, but testing it is quite another. The combination of 
the Python shell and IDLE is great for testing and experimenting with small 
snippets of code, but for anything substantial, a testing framework is a must. 

Python comes with two testing frameworks out of the box. 

The first is familiar to programmers coming from another modern language, 
because it’s based on the popular xUnit testing framework. Python’s 
unit test module (which is part of the standard library) lets you create test 
code, test data, and a test suite for your modules. These exist in separate files 
from you code and allow you to exercise your code in various ways. If you 
already use a similar framework with your current language, rest assured that 
Python’s implementation is essentially the same. 


The other testing framework, called doctest, is also part of the standard 
library. This framework allows you to take the output from a Python shell or 
IDLE session and use it as a test. All you need to do is copy the content from 
the shell and add it to your modules documentation strings. If you add code like 
this to the end of your modules, they’ll be ready for “doctesting ”： 


if 


name 


main 


import doctest 
doctest.testmod() 


^ y°^ is impovied 
as a module, this todt 

docs HOT v^uh. 1^ you v^uh 

r OWr module -the 

匕 ommdhd lihe, youv tests 
v-uh. 


If you then run your module at your operating systems comand line, your 
tests run. If all you want to do is import your module’s code and not run your 
tests, the previous if statement supports doing just that. 

For more on unittest and doctest, search the online Python 
documentation on the Web or via IDLE’s Help menu. 


What do you mean ： 
you can’t hear me...I 
guess I should ve 
tested this first, eh? 


O 
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# 4: Advanced language features 


With a book like this, we knew we’d never get to cover the entire Python 
language unless we tripled the page count. 

And let’s face it, no one would thank us for that! 


There’s a lot more to Python, and as your confidence grows, you can take the 
time to check out these advanced language features: 

Anonymous functions: the lambda expression lets you create small, one- 
line, non-named functions that can be incredibly useful once you understand 
what’s going on. 

Generators: like iterators, generators let you process sequences of data. 
Unlike iterators, generators, through the use of the yield expression, let 
you minimize the amount of RAM your program consumes while providing 
iterator-like functionality on large datasets. 

Custom exceptions: create your own exception object based on those 
provided as standard by Python. 


Function decorators: adjust the behavior of a preexisting function by 
hooking into its start-up and teardown mechanisms. 


Metaclasses: custom classes that themselves can create custom classes. 
These are really only for the truely brave, although you did use a metaclass 
when you created your Sightings form using the Django form validation 
framework in Chapter 10. 

Most (but not all) of these language features are primarily of interest to the 
Python programmer building tools or language extensions for use by other 
Python programmers. 

You might never need to use some of these language features in your code, 
but they are all worth knowing about. Take the time to understand when and 
where to use them. 

See #10 of this appendix for a list of my favorite Python books (other than 
this one), which are all great starting points for learning more about these 
language features. 
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# 5: Regular expressions 


When it comes to working with textual data, Python is a bit of a natural. 

The built-in string type comes with so many methods that most of the 
standard string operations such as finding and splitting are covered. However, 
what if you need to extract a specific part of a string or what if you need 
to search and replace within a string based on a specific specification? It is 
possible to use the built-in string methods to implement solutions to these 
types of problems, but —— more times than most people would probably like to 
admit to —— using a regular expression works better. 

Consider this example, which requires you to extract the area code from the 
phone_number string and which uses the built-in string methods: 


角 o . area_code„py - /Users/barryp/HeadFirstPythoni/Top Ten Things/area_code»py 


phone_rmmber = 11 Homei (555) 265-2901 1 ' 

. w/w 

start = phone number, findj F ( r ) ( __ r^d 

start = start+in _Cal 匕山 te wheve the Codt is 

end - start+3 少 < :-- the siv—. 

area code - phone_number [ start: end] ^todc- 

print ( r The area code isi ' + areacode) 


Ln: 12 Cof- 0 




y/WiA is v/cll 赠从 a 

look y ou ^6 
ledm wove. L-ook uf 


Acmodule m 
dots, *to。. 


This code works fine, but it breaks when presented with the following value for 



docs -this phohe _b 饮 

the pvogvam -to ^i|? Tvy 
•t ahd see what happd. 


When you use a regular expression, you can specify exactly what it is you 
are looking for and improve the robustness of your code: 


m o ' area code re,py - /Users/bariryp/HeadFirstPythonyTop Ten Things/area code re.py 



^ looh a |iU| c s— 
but this lrcgulair exp^cssioh 

' s ,ookih 9 T { 

+ollowcd by digits 
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啸 c likely 铋 ^ihd ihc 
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# 6: More on web frameworks 

When it comes to building web applications, CGI works, but it’s a little 
old-fashioned. As you saw in Chapter 10, Google’s App Engine technology 
supports CGI, but also WSGI and a number of web framework technologies. 
If you aren’t deploying to the cloud and prefer to roll your own, you have 
plenty of choices. What follows is a representative sample. My advice: try a 
few on for size and see which one works best for you. 

Search for the following terms in your favorite search engine: Django, Zope, 
TurboGears, Web2py, and Pylons. 


The W old timc\rs w ..bu-t 
Id 4 ol 

y ° u： 卜 c ⑽ 

web Tirdmcwoirks. 



django 
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# 7: Object relational mappers and NoSQL 

Working with SQL-based databases in Python is well supported, with the 
inclusion of SQLite in the standard library a huge boon. Of course, the 
assumption is you are familiar with SQL and happy to use SQL to work with 
your data. 

But what if you aren’t? What if you detest SQL? 

An object relational mapper (ORM) is a software technology that lets 
you use an underlying SQL-based database without having to know anything 
about SQL. Rather than the procedural interface based on the Python 
database API, ORMs provide an object-oriented interface to your data, 
exposing it via method calls and attribute lookups as opposed to columns and 
rows. 

Many programmers find ORMs a much more natural mechanism for 
working with stored datasets and the Python community creates and supports 
a number of them. 

One of the most interesting is SQL Alchemy, which is popular and included 
in a number of the web framework technologies discussed in #6. Despite 
being hugely popular anyway, SQL Alchemy is also interesting because it 
supports both Python 2 and Python 3, which makes it a standout technology 
(for now). 

If you find yourself becoming increasingly frustrated by SQL, check out an 
ORM. Of course, you have already experienced a similar technology: Google 
App Engine’s datastore API is very similar in style to those APIs provided by 
the major Python ORMs. 


^OLAlchemjj 


There's NoSQL, too. 

In addition to database technologies that let you avoid working with the 
underlying SQL-based database, a new breed of technologies have emerged 
that let you drop your SQL database in its entirety. Known collectively as 
NoSQL, these data tools provide an alternative non-SQL API to your 
data and do not use an SQL-based database management system at all. As 
these technologies are relatively new, there’s been more activity around 
Python 2 than Python 3, but they are still worth checking out. CouchDB 
and MongoDB are the two most closely associated with robust Python 
implementations. If you like working with your data in a Python dictionary 
and wished your database technology let you store your data in much the 
same way, then you need to take a look at NoSQL: it’s a perfect Jit. 


CouchDB 
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# 8: Programming &Uls 

In this book, you’ve created text-based interfaces, web-based interfaces and 
interfaces that ran on Android devices. But what if you want to create a 
desktop application that runs on your or your user’s desktop computer? Are 
you out of luck, or can Python help here, too? 

Well … as luck would have it, Python comes preinstalled with a GUI-building 
toolkit called tkinter (shorthand for Tk Interface). It’s possible to create a usable 
and useful graphical user interface (GUI) with tkinter and deploy it on Mac 
OS X, Windows, and Linux. With the latest version of Tk, your developed app 
takes on the characteristics of the underlying operating system, so when you 
run on Windows, your app looks like a Windows desktop app, when it run on 
Linux, it looks like a Linux desktop app, and so on. 

You write your Python and tkinter code once, then run it anywhere and it just 
works. There are lots of great resources for learning to program with tkinter, 
with one of the best being the last few chapters of Head First Programming, but 
since plugging that book would be totally shameless, I won’t mention it again. 

Other GUI-building technologies do exist, with the PyGTK, PyKDE, 
wxPython, and PyQT toolkits coming up in conversation more than most. Be 
warned, however, that most of these toolkits target Python 2, although support 
for Python 3 is on its way. Search the Web for any of the project names to learn 
more. 


0\\, look ： or\t of 七匕 
^UU crcaicd m w Hcad r\rst 

yes, I sa.d 

I v/ould〆 七 wcyrbcm THAT 

book aja'm, 





^41312 M 


RFD 


you are here ► 


443 















your bugs, my bugs, and threads 


# 9: Stuff to avoid 


When it comes to stuff to avoid when using Python, there’s a very short list. A 
recent tweet on Twitter went something like this: 



Threads do indeed exist in Python but should be avoided where possible. 

This has nothing to do with the quality of Python’s threading library and 
everything to do with Python’s implementation, especially the implementation 
known as C Python (which is more than likely the one you’re running 
now). Python is implemented using a technology known as the Global 
Interpreter Lock (GIL), which enforces a restriction that Python can only 
ever run on a single interpreter process, even in the presence of multiple 
processors. 

What all this means to you is that your beautifully designed and implemented 
program that uses threads will never run faster on multiple processors even 
if they exist, because it can’t use them. Your threaded application will run 
serially and, in many cases, run considerably slower than if you had developed 
the same functionality without resorting to threads. 

Main message: don’t use threads with Python until the GIL restriction is 
removed. ..if it ever is. 
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# 10: Other books 

There are lots of great books that cover Python in general, as well as 
specifically within a particular problem domain. Here is a collection of my 
favorite Python books, which we have no hestitation in recommending to you. 
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Syinbols and Numbers 

404 Error, from web server 242 

405 Error, from web server 378 


>>> (chevron, triple) IDLE prompt 4 

: (colon) 

in for loop 16 
in function definition 29 
in if statement 20 

， (comma) separating list items 7 

{} (curly braces) 

creating dictionaries 180 
creating sets 166 

=(equal sign) 

assignment operator 7 
in function argument definition 63 

(...) (parentheses) 

enclosing function arguments 29 
enclosing immutable sets 91 

+ (plus sign) addition or concatenation operator 138 
# (pound sign) preceding one-line comments 38 
@property decorator 250, 253, 285 
? (question mark) parameter placeholder 321, 350 
or(quotes) enclosing each list item 7 

or (quotes, triple) enclosing comments 37 
;(semicolon) separating statements on one line 38 

[...] (square brackets) 

accessing dictionary items 180, 212 
accessing specific list items 9, 18 
enclosing all list items 7, 18 


A 


u a’’ access mode 


110 


access modes for files 110, 133 


addition operator (+) 138 
Alt-N keystroke, IDLE 5 
Alt-P keystroke, IDLE 5 
AndFTP app 288-289 
Android apps 

accepting input from 278-282, 295, 304-307 
converting from Python code 424—430 
creating 274-277, 281-282 
data for. JSON data interchange format 
integrating with SQLite 342—348 
running on phone 288—289 
scripting layer for. See SL4A 
troubleshooting 277 

Android emulator 

installing and configuring 260—262 
running scripts on 264-265, 272—273, 283 

Android Market 288 
Android Virtual Device. See AVD 
anonymous functions 439 
appendO method, lists 10, 14 
apps. See Android apps; webapps 
app.yaml file 356, 395 

arguments for functions 
adding 52, 66-68 
optional 63—64, 134 

arrays 

associative. See dictionaries 
similarity to lists 9-10, 17 

as keyword 119, 138 

assignment operator (=) 7 

associative arrays. See dictionaries 

attributes, class 190, 194, 212 

authorization, user 389—393 

AVD (Android Virtual Device) 261,291 
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B 

“batteries included” 32 
BIFs. See built-in functions 
BigTable technology 354, 359 
blue text in IDLE 4 
books 

Dive Into Python 3 (GreateSpace) 445 
Head First HTML with CSS & XHTML (O’Reilly) 
374 

Head First Programming (O’Reilly) 443 
Head First SQL (O’Reilly) 313 
Learning Python (O’Reilly) 445 
Mastering Regular Expressions (O’Reilly) 440 
Programming in Python 3 (Addison-Wesley Profes¬ 
sional) 445 

Python Essential Reference (Addison-Wesley Profes¬ 
sional) 445 

Python for Unix and Linux System Administration 
(O^eilly) 445 

braces. See curly braces 

brackets, regular. See parentheses 

brackets, square. See square brackets 

BSD, running CGI scripts on 239 

build folder 42 

built-in functions (BIFs). See also specific functions 
displayed as purple text in IDLE 4 
help on 21 

importing of, not needed 55 
namespace for 55 
number of, in Python 21 

— builtins — namespace 55, 71 

c 

cascading style sheet (CSS) 374-375 
case sensitivity of identifiers 17 
cgi-bin folder 234, 235 

CGI (Common Gateway Interface) scripts 217, 235, 243, 
253. See also WSGI 

location of 234, 235 
running 239 

running from Android 264—265, 272—273, 283 


sending data to 300—303 
tracking module for 248—249 
troubleshooting 242, 247-250 
writing 236—238, 244-246 
writing for Android. See SL4A 

cgi library 300 

cgitb module 248—249, 253 

chaining 

functions 146, 172 
methods 142， 172 

chevron, triple (>>>) IDLE prompt 4 

chmod command 239, 253 

classes 189-191 

attributes of 190, 194, 212 
benefits of 189 

converting data to dictionary 285-286 
defining 190-193, 194, 195-196 
inherited 204-209, 212 
instances of 190, 191, 194, 195-196 
metaclasses 439 

methods of 190 ， 195-196, 198-200 
in modules 209, 212 

class keyword 191, 212 

closeO method, database connection 315, 350 

closeO method, files 75， 103 

code editors 35, 436. See also IDLE 

colon (:) 

in for loop 16 
in function definition 29 
in if statement 20 

comma (，）separating list items 7 
comments 37-38 

commitO method, database connection 315, 350 
Common Gateway Interface scripts. See CGI scripts 
comprehension, list 154—159, 172, 409—411, 432 
concatenation operator (+) 138 
conditional list comprehension 409—411，432 
conditions. See if/else statement 

connection, database 
closing 314, 315 
creating 314, 315 
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connectO method, sqlite3 315, 350 
context management protocol 120 

Controller, in MVG pattern 221 
for GAE webapps 359, 370—373 
for webapps 234-238, 244-246 

“copied” sorting 144, 145-146, 172 

CREATE TABLE statement, SQL 317, 319—320 

CSS (cascading style sheet) 374-375 

CSV format, converting to Python data types 401—405 

curly braces ({}) 

creating dictionaries 180 
creating sets 166 

cursorO method, database connection 315, 350 
custom code 131 
custom exceptions 439 

D 

data 

for Android apps. JSON data interchange format 

bundling with code. See classes 

duplicates in, removing 161—163, 166—167 

external. See database management system; files 

for GAE webapps. See datastore, for GAE 

nonuniform, cleaning 148—153 

race conditions with 309—310 

Robustness Principle for 384-387 

searching for closest match 416—417 

sending to web server 275, 291 

sorting 144—147, 172 

storing. See persistence 

transforming, list comprehensions for 154—159 
database API 314-315, 350 

database management system 312 
closing connection to 314, 315 
commit changes to data 314, 315, 350 
connecting to 314, 315 
cursor for, manipulating data with 314, 315 
designing 316-318 
inserting data into 321, 324, 348 
integrating with Android apps 342-348 
integrating with webapps 327—341 
managing and viewing data in 326 
process for interacting with 314—315 
querying 322, 332—333 


rollback changes to data 314, 315, 350 
schema for 317 
SQLite for. See SQLite 
tables in 317, 319—320, 350 

data folder 234 

data interchange format. JSON data interchange 
format 

data objects. See also specific data objects 
getting next item from 54 
ID for 54 

length of, determining 32 
names of. See identifiers 

datastore, for GAE 359-360, 380-383, 384-387, 395 
data types 

converting CSV data into 401-405 
converting strings to integers 54 
in datastore 360 
immutable 91, 103, 116, 138 
forJSON 285 
for list items 8, 12 

date and time data 

format compatibility issues 418-423 
property type for 362, 384—385 

db.BlobO type 360 
db.DatePropertyO type 360 
db.IntegerPropertyO type 360 
db.StringPropertyO type 360, 385 
db.TimePropertyO type 360 
db.UserPropertyO type 360, 390 
decision statement. See if/else statement 
decorators, function 439 
def keyword 29, 191， 212 

dialogGreateAlertO method, Android API 274, 276, 280 

dialogGetlnputO method, Android API 295, 304—306 

dialogGetResponseO method, Android API 274, 276 ， 
278, 280 

dialogGetSelectedltemsO method, Android API 278, 280 

dialogSetltemsO method, Android API 279, 280 

dialogSetNegativeButtonTextO method, Android API 
274, 276 

dialogSetPositiveButtonTextO method, Android API 274, 
276, 280 
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dialogSetSingleGhoiceltemsO method, Android API 274, 
276 

dialogShowO method, Android API 276, 280 

dictO factory function 180, 212 

dictionaries 178-182, 212 
accessing items in 180, 212 
compared to lists 179 
converting class data to 285-286 
creating 180, 182, 186 
dictionaries within 407—409 
keys for 178, 180, 212 
populating 180, 212 
reading CSV data into 403-404 
values of 178, 180, 212 

dirO command 225 

directory structure. See folder structure 

dist folder 42 

distribution 

creating 40—42 
updating 60—61, 65 
uploading to PyPI 48 

Dive Into Python 3 (GreateSpace) 445 
djangoforms.ModelForm class 368 
Django Project 

Form Validation Framework 368—369, 395 
templates 363-366, 395 

doctest framework 438 

documentation for Python 3 3, 80, 103 

dot notation 10, 194, 196 

double quotes. See quotes 

dumpO function, pickle 133-134, 138 

dumpsO function, json 269, 272, 281， 291 

dynamic content 216, 217 

E 

Eclipse editor 35 

editors 35, 436. See also IDLE 

elif keyword 108. See also if/else statement 

else keyword. See if/else statement 

emacs editor 35, 436 


enableO function, cgitb 248, 253 
end_formO function, yate 231, 233 
entities, in datastore 360, 395 
enumerate0 built-in function 54 
environ dictionary 300, 350 

equal sign (=) 

assignment operator 7 
in function argument definition 63 

errors. See exception handling; troubleshooting 

exception handling 88-95, 103. See also troubleshooting 
benefits of 95, 100 
closing files after 114-115, 120-123 
custom exceptions 439 
defining with try/except statement 89, 91—94 
ignoring found errors 93—94 
IndexError exception 17 
IOError exception 103 ， 112—114, 117—119 
for missing files 96—98 
NameError exception 44， 118 
PickleError exception 133—134 
specific errors, checking for 101—102 
specific errors, details about 117—119 
TypeError exception 56-57, 116, 247-249, 283-285 
ValueError exception 78-79, 81-82, 103 

exception objects 119,138 
except keyword. See try/except statement 
executeO method, cursor 315, 322, 324, 350 
extendO method, lists 10 

F 

F5 key, IDLE 39, 44, 49, 71 

factory functions 166 

favicon.ico file, for webapp 234 

fetchallO method, cursor 322 

fetchmanyO method, cursor 322 

fetchoneO method, cursor 322 

FieldStorageO method, cgi 244, 253, 296, 300, 350 

files. See also persistence 

access modes for 110, 133 
appending data to 110 
checking for existence of 118 
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closing 75, 110 

closing after exception 114-115, 120—123 
CSV format, converting to Python data types 401— 
405 

exceptions involving, determining type of 117—119 
flushing 110 

missing, exception handling for 96—98 

opening 75, 109—110 

opening in binary access mode 133 

reading data from 75-78, 142-143 

rewinding 76 

splitting lines in 77-78 

writing 110—113 

writing, custom formats for 126—130 
writing, default format for 124—125 
writing, pickle library for. See pickle library 

finally keyword 115, 138 

findO method, strings 84-86, 103 

Firefox, SQLite Manager for 326 

folder structure 

for distribution 42 
for GAE 356, 370 
for webapps 234 

for loop 15-17, 32 

compared to list comprehension 432 
nesting 19-22 

forms, HTML 295 

creating from template 296—299 
Form Validation Framework for 368—369 
input restrictions for 376—377, 384-387 
sending data to CGI scripts 300-303 
stylesheets for 374-375 

Form Validation Framework 368—369, 395 
405 Error, from web server 378 
404 Error, from web server 242 

Friedl, Jeff (author, Mastering Regular Expressions) 440 

from statement 46, 49 

functional programming concepts 157 

function decorators 439 

functions 

adding arguments to 52, 66-68 
anonymous 439 

built-in. See built-in functions (BIFs) 


chaining 146, 172 
creating 28-30, 170—171 
optional arguments for 63—64，134 
recursive 31 
sharing. See modules 

G 

GAE (Google App Engine) 354 

configuration and setup for 356-357 

controller code for 370—373 

data modeling with 360—362 

datastore for 359, 380-383, 384-387, 395 

deploying webapps to Google cloud 391 

folder structure for 356, 370 

form generation for 368—369 

form input restrictions for 376—377, 384-387 

form stylesheets for 374—375 

MVG pattern used by 359 

SDK for, downloading 355 

troubleshooting 378 

user authorization for 389—393 

view for, desigining 363—369 

GAE Launcher 357, 391, 395 
garbage collection 116 
generators 439 

getO method, GAE 370, 379, 395 
GET web request 370 
GIL (Global Interpreter Lock) 444 
glob module 237, 253 
Google App Engine. See GAE 
Google BigTable technology 354, 359 
GQL (Google Query Language) API 359 
green text in IDLE 4 

GUI (graphical user interface), building 443 

H 

hashes. See dictionaries 
headerO function, yate 231， 233 

Head First HTML with CSS & XHTML (O’Reilly) 374 
Head First Programming (O’Reilly) 443 
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Head First SQL (O’Reilly) 313 
helpO built-in function 80, 103 
HTML 

generating for webapp interface 230—231 
learning 226 

templates for, with Django 363—366 
HTML forms. See forms, HTML 
HTTP server 235 
http.server module 235, 253 



idO built-in function 54 
IDE 436. See also IDLE 
identifiers 7, 17, 32 

IDLE 3-5, 32 

colored syntax used in 4 
indenting enforced in 4 
preferences, setting 5 
prompt in (>>>)4 

recalling and editing code statements 5 
running or loading code in 39, 44, 49, 71 
TAB completion 5 

if/else statement 20, 32 
elif keyword 108 
in list comprehension 432 
negating conditions in 86, 103 

images folder 234 

immutable data types 138 
lists 91, 103, 116 
numbers 116 
strings 116 

import statement 43, 46, 49, 71 
include_footer() function, yate 230, 232, 233 
include_header() function, yate 230, 232 

indentation rules 

enforced in IDLE 4 
for for loops 16 
for function definitions 29 
for if statement 20 


IndexError exception 17 
index.html file, for webapp 234 
inherited classes 204-209, 212 
— init_0 method 191, 212 
in operator 16, 118, 138 
“in-place” sorting 144, 145, 172 
input 

from Android apps 278-282, 295, 304-307 

HTML forms for. See forms, HTML 

from keyboard after screen prompt 413—414, 432 

inputO built-in function 413—414, 432 

insertO method, lists 10, 14 

INSERT statement, SQL 321 ， 324, 348 

instances of classes 190, 191, 194, 195-196 

intO built-in function 54 

integers, converting strings to 54 

interface. See View, in MVG pattern 

IOError exception 103 ， 112—114, 117—119 

I/O (input/output), handling. See files 

isinstanceO built-in function 20—22, 32 

iterations 

for loop 15-17, 19-22, 32 
generating with range0 function 54—56 
while loop 16—17 



JSON data interchange format 266—267, 291 
API for, using 269—272 
browser differences with 272 
data types supported by 285 
incompatibility with pickle data objects 284-285 

K 

KDevelop IDE 436 

keys, in dictionary 178, 180, 212 

keywords, displayed as orange text in IDLE 4 
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lambda expression 439 
Learning Python (O’Reilly) 445 
lenO built-in function 10, 32 
lib folder 42 
Linux 

code editors for 35 

GAE log messages on 378 

IDEs for 436 

installing Python 3 on 3 

running CGI scripts on 239, 272 

running GAE Launcher on 357 

transferring files to Android device 288 

listO built-in function 54 

list comprehension 154—159, 172, 409—411, 432 

lists 32. See also data objects 
adding items to 10-14 
bounds checking for 17 
classes inherited from 204-208 
compared to dictionaries 179 
compared to sets 167 
creating 6-7, 54 
data types in 8, 12 
duplicates in, removing 161-163 
extracting specific item from 175—176 
getting next item from 54 
identifiers for 7 
immutable 91, 103, 116 
iterating 15-17, 157 
length of, determining 10, 32 
methods for 10 
nested, checking for 20—22 
nested, creating 18-19 
nested, handling 23-25, 28-31 
numbered, creating 54 
reading CSV data into 403-404 
removing items from 10 
similarity to arrays 9—10, 17 
slice of 160, 172 

loadO function, pickle 133,138 
loadsQ function, json 269, 276, 280, 291 


localsO built-in function 118, 138 
loops. See iterations 

M 

Mac OS X 

code editors for 35 

GAE log messages on 378 

IDEs for 436 

installing Python 3 on 3 

running CGI scripts on 239, 272 

running GAE Launcher on 357 

transferring files to Android device 288 

— main — namespace 45 

MANIFEST file 42 

mappings. See dictionaries 

Mastering Regular Expressions (O’Reilly) 440 

metaclasses 439 

methods 190. See also specific methods 
chaining 142， 172 
for classes 195-196, 198-200 
creating 212 

results of, as attributes 250, 253 
self argument of 212 

ModelForm class, djangoforms 368 

Model, in MVG pattern 221 

for GAE webapps 359, 360—362 
for webapps 222-225 

Model-View-Controller pattern. See MVG pattern 

modules 34—36, 71 

adding functionality to 50—52 
classes in 209,212 
creating 35 

distribution for, creating 40-42 
distribution for, updating 60-61, 65 
distribution for, uploading to PyPI 48 
importing 43—44, 46 
loading in IDLE 39, 49, 71 
locations for 38, 49 
namespaces for 45-46, 71 
in Python Standard Library 36 
third-party 36 
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Monty Python 17 
multiple inheritance 209 

MVG (Model-View-Controller) pattern 221, 232, 253, 
359 

Controller 234-238, 244-246, 370—373 
Model 222-225, 360-362 
View 226-233, 363-369 

N 

NameError exception 44, 118 
names. See identifiers 
namespaces 45-46, 71 
nextO built-in function 54 
NoSQL 359, 442 
NotePad editor 35 
not in operator 161—162 
not keyword 86, 103 
numbered lists 54 

0 

object relational mapper. See ORM (object relational 
mapper) 

objects. See data objects 

openO built-in function 75, 103, 109—110 

orange text in IDLE 4 

ORM (object relational mapper) 442 

os module 76, 300, 350 

P 

paraO function, yate 231， 233 

parentheses ((“•)） 

enclosing function arguments 29 
enclosing immutable lists 91 

pass statement 93, 103 

persistence 105 

pickle library for 132—137 
reading data from files 222-224 
writing data to files 110—113, 222-224 

PickleError exception 133—134 


pickle library 132-137, 138 

data modeling using 222-224 
incompatibility with JSON data types 284-285 
transferring data to a database 321-325 

plus sign (+) addition or concatenation operator 138 
popO method, lists 10, 175-176 
postO method, GAE 379-383, 395 
POST web request 379 

pound sign (#) preceding one-line comments 38 

print0 built-in function 10, 32 ， 124-125 
disabling automatic new-line for 56, 71 
displaying TAB character with 56 
writing to a file 110 ， 128， 138 

Programming in Python 3 (Addison-Wesley Professional) 
445 

properties, in datastore 360, 395 
@property decorator 250, 253, 285 
purple text in IDLE 4 
putO method, GAE 395 
.pyc file extension 42, 49 
.py file extension 35 

PyPI (Python Package Index) 36 
registering on website 47 
uploading distributions to 48 
uploading modules to 209 

Python 2 

compared to Python 3 17 

raw_inputO built-in function 432 

running on Android smartphones 258—259, 291 

using with Google App Engine 355 

Python 3 

compared to Python 2 17 
documentation for 3, 80, 103 
editors for 35, 436 
installing 3 

interpreter for. See IDLE 
learning 445 

python 3 command 

building a distribution 41 
checking for Python version 3 
installing a distribution 41 
uploading a new distribution 68 
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Python Essential Reference (Addison-Wesley Professional) 
445 

Python for Unix and Linux System Administration 
(O’Reilly) 445 

Python, Monty 17 

Python Package Index. See PyPI 

Python Standard Library 36 

querying a database 322, 332—333 

question mark (?) parameter placeholder 321， 350 

quotes or enclosing each list item 7 

quotes, triple or enclosing comments 37 

R 

“r” access mode 110 
race conditions 309—310 
radio_buttonO function, yate 231， 233 
range0 built-in function 54-56, 71 
raw—input() built-in function 432 
readlineO method, files 76, 103， 142 
recursion 31 

regular brackets. See parentheses 

regular expressions 440 

re module 440 

remove0 method, lists 10 

renderO function, template 364, 366 

Robustness Principle 384-387 

rollbackO method, database connection 315, 350 

runtime errors 88. See also exception handling; trouble¬ 
shooting 



schema, database 317 
scoping of variables 437 
Scripting Layer for Android. See SL4A 
scripts. See CGI scripts; SL4A 


sdist command 41 

seekO method, files 76,103 

SELEGT/OPTION, HTML tag 376 

SELECT statement, SQL 322, 332—333 

self argument 192—193, 212 

self, re quest object 379, 395 

self.response object 372, 379, 395 

semicolon (;) separating statements on one line 38 

setO built-in function 166, 172 

sets 166, 167, 172 

setupO built-in function 40 

setup.py file 40, 71 

single quotes. See quotes 

SL4A (Scripting Layer for Android) 258, 291 
adding Python to 263 
Android apps, creating 274—277 
automatic rotation mode, setting 264 
documentation for 274 
installing 262 

Python versions supported 258-259 
slice of a list 160, 172 
smartphones, apps on. See Android apps 
sortedO built-in function 144-147, 153, 158, 172 
sortO method, lists 144-145, 153, 172 
splitO method, strings 77-78, 80-81, 103, 142 
SQL Alchemy 442 

SQLite 313, 350 

closing connection to 314,315 

committing data to 314, 315 

connecting to 314, 315 

cursor for, manipulating data with 314, 315 

designing database 316-318 

inserting data into 321, 324, 348 

integrating with Android apps 342-348 

integrating with webapps 327—341 

managing data in 326 

process for interacting with 314—315 

querying 322, 332—333 

rollback changes to data 314 

schema for database 317 

tables in, creating 319—320 
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sqlite3 command 326 

sqlite3 library 313, 315, 350 

SQLite Manager, for Firefox 326 

SQL (Structured Query Language) 313, 350. See 
also NoSQL; SQLite; ORM 

square brackets ([...]) 

accessing dictionary items 180, 212 
accessing specific list items 9, 18 
enclosing all list items 7, 18 

standard error (sys.stderr) 248, 291 

standard input (sys.stdin) 291 

Standard Library, Python 36 

standard output (sys.stdout) 126—128, 291 

start_formO function, yate 231, 233 

start_responseO function, yate 230, 232 

static content 216, 217 

static folder 370 

strO built-in function 119, 138 

strings 

concatenating 138 
converting other objects to 119 
converting to integers 54 
displayed as green text in IDLE 4 
finding substrings in 84—86 
immutable 116 
sorting 148 
splitting 77-78, 80-81 
substitution templates for 230, 253 

strip0 method, strings 108, 138, 142 

Structured Query Language. See SQL 

stylesheets for HTML forms 374—375 

suite 16, 29, 32 

sys module 291 

sys.stdout file 126—128, 138 


T 

TAB character, printing 56 

TAB completion, IDLE 5 

tables, database 317, 319-320, 350 

target identifiers, from splitf) method 77, 91 

.tar.gz file extension 42 

Template class 230, 253 

template module 364 

templates folder 234, 370 

templates for GAE 363-366, 395 

testing code 438 

TextMate editor 35, 436 

third-party modules 36 

threads 444 

time data 

format compatibility issues 418-423 
property type for 362, 384—385 

time module 419, 432 

Tk Interface (tkinter) 443 

traceback 88, 103. See also exception handling; trouble¬ 
shooting 

tracing code 58-59 

triple chevron (>>>) IDLE prompt 4 

triple quotes or ‘”•••’”）enclosing comments 37 

troubleshooting. See also exception handling 

404 Error, from web server 242 

405 Error, from web server 378 
Android apps 277 

GAE webapps 378 
testing code 438 
tracing code 58-59 

try/except statement 89, 93—94, 101—102, 103 
finally keyword for 115, 138 
with statement and 120-123 

tuples 91, 103, 116 

TypeError exception 56-57, 116, 247-249, 283-285 
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TJ 

u_listO function, yate 231， 233 
unittest module 438 
urlencodeO function, urllib 291 
urllib2 module 291 
urllib module 291 
urlopenO function, urllib2 291 
user authorization 389—393 
user input. See forms, HTML; input 
UserPropertyO type, db 390 

V 

ValueError exception 78-79, 81-82, 103 
values, part of dictionary 178, 180, 212 
variables, scope of 437 
vi editor 35, 436 

View, in MVG pattern 221 

for GAE webapps 359, 363—369 
for webapps 226—233 

vim editor 436 


webapps 215-217, 253 

controlling code for 221, 234-238, 244-246 

data modeling for 221, 222-225 

designing with MVG 221 

design requirements for 218—220 

directory structure for 234 

Google App Engine for. See GAE 

input data, sending to CGI scripts 300—303 

input forms for. See forms, HTML 

SQLite used with 327—341 

view for 221 ， 226—233 

Web-based applications. See webapps 
web frameworks 441. See also CGI; WSGI 
web request 216, 253, 395 
web response 216—217, 253, 395 
web server 216—217, 235 

Web Server Gateway Interface (WSGI) 356, 370. See 
also CGI scripts 

while loop 16-17, 55 

WingIDE editor 35 

WingWare Python IDE 436 

with statement 120—123, 138 

WSGI (Web Server Gateway Interface) 356, 370. See 
also CGI scripts 


W 


Y 


“w” access mode 110 
“w+” access mode 110 
“wb” access mode 133 


yate (Yet Another Template Engine) library 226—233 
yield expression 439 
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